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The University of Michigan Rehabilitation Research, Institute (UM-RRI ) - 
was established in 1976 with funding from the^National Institute of Handi- 
gapped Research in response to th§ mandate of the # -Rehabi I i tat ion Act of 1 973- 
that rehab fj i tat I on programs and 'projects be evaluated. The.-UM-RRI's efforts 
are directed toward research and related activities to assist states in "* ■ 

I 

s 

evaluating .management practices and service delivery systems. 

The UM-RRI has been norking'on several long and short range objectives 
in rehab i I itaJ^Qn program evaluation to* 1 * 

1. Develop alternative Conceptual models - that may be uspcf as a 
framework for comprehensive program evaluation \n the state- 
federal rehab i f i tat ion program 

2. Conduct research on existing program evaluation Instruments 
to determine their feasibility for current use and to deter- 
mine their need for additional development and validatipn 

" * f . 

3. Identify,, design, develop, test, va I fdate> ' demonstrate, and" 
disseminate program evaluation instruments, techniques, and 

, methodologies that are consistent with conceptual models <for 
comprehensive program eva-Iuation ^'rehabilitation 

4. - O^elop criteria for designing, developing, testing, and 

validating new and existing program evaluation instruments, 
techniques, and methodologies that consider measurement of 
^ impact, effectiveness, effort, efficiency, and output 

\ The production of this monograph on.cli^pt assessment measures in 

rehabi I i tat iorsjs consistent with these objectives of .the UM-TJR I * 



DQn K. Harrison 
J i ri M. Garnett, * 
Albert L. Wat 



Ann Arbor 
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• 1 • INTRODUCTION ' • « , - 

» 

t Ratiopaje for a .Collection of Client Measures, in Rehabilitation 

* . The cfosu re' status "rehabilitated" or "not rehabilitated" is used when* 
» • 

the sta+e-fgdera I vocational rehabil itatjon (VR) program attejnpts*to evaluate 

the success" of rehabi I i tat ion .services on the fc I lent. If the client obtains 

* 

gainful .employment following program acceptance .and the provision of rehatiil- 
i'tation services, *the client i?~ considered to have been rehabilitated (Status 
26),*^ If the client does not obtain employmeht after acceptance' and provision 
of service^ the client is considered to have not been rehabilitated (Status 30). 

Other measures of client outcomes, in addition Jro employment status, can 

i - . . 

broaden t&e picture regarding the impact of rehab i I itatjon services. Several 

. % ' . 

general questions may illustrate the type of information that may fc be' useful : 
U)^To what extent does the cl ient, perform sejf-pare> acti vi ties^at the time of 
closure compared tatfie time of acceptance? (2) What client changes have occurred 
physically, socially; and psychologically which nray be attributed to rehabllita- » 
tion services? (3) How satisfied is the client with the rehabilitation ser- 
vices? (4) What kinds of, benefits are being maintained by the client after the ces 
sation of rehabilitation services? These questions suggest mul tip le criteria. 

The consideration of multiple rehabilitation outcomes, rather fhan the * » 
sing le outcopie of employment, Is consistent with provisions An the Rehabilitation 
Act-of 1973 and its amendments, reflected in the funding support for research , 
and demonstration projects on independent living rehabilitation TILR). Moreover, 

determi ning^the multiple gains that each client may have made as"a*result of \ 

* * 

rehabilitation is consistent with a definition of rehabilitation which focuses 
upon individual client need;^the f-estoration of the individual to the maximal 
.level of functioning possible « medical ly,. physical ly, mentally, psychologically, 
vocationally, and economically.* / • 



Measurement Beyynd Status 26 Closure - ^ 
If one wishes to go beyond closure status-and obtain addifional data on 
VR Impact, the t se lection of appropriate measuring instruments becomes an 
fmportant proems in the program evaluation. The accuracy and' appropriate- 
ness of the data gathered 'certainly influence the legitimacy o v f subsequent 
ftndings^nd recommendations. As part of the llM-RRI 1 s mi ss'ton <*to enhance the 
program evaluati6n capacity of state VR agencies, *this^monograph on client 
outcome measures' was developed to assist the program evaluator in this^selection 

^ -A 

process. The monograph intends to provide program evaluators wUh further in- 
formation about client measures in the areas of functional limitations, client 
change, client satisfaction, and client retention of benefits'. 

;The need to disseminate irriormat^on on measures of client assessment seems 
apparent from the results of a state survey conducted 'in I98Q. -Survey results 
indicatecf^t hat .many client outcome measures used rb^t prog ram evaluators in the * 
state-federa I. prdgram were* limited to the areas pf client satisfaction and re- 
tent ion of benefits. Such instruments were used to comply with the report fng 
requirements of the FecJeral Evaluation Standards. While such measures serve 
important needs of program evaluators, the intent of this fnonograph is to assist 
program evaluators in expanding their efforts in the area of client outcome meas 
urement by increasing their awareness of tne various ^way? of measuring the im- 
pact of rehabilitation services on clients. f 

v. ■ ■ 



The Instrument Selection Process 

l^e^mea 



Several ^approaches were" taken in 1j*e searoh for appropriate^ measures «for 



Tncluslon In tjjls jnonograph. A^dfscus^pn follows of the key .points in this 
process and the t coJ lectiorf of measures that has resulted. ^ 



Computerized Literature Search ** * » 

A computerized search* of the 1 1 terature was' among the steps undertaken 

to uncover relevant assessment measures. Among the data bases searched were ' 

. . i " . ' ' * * , * • • > 

Educational Resources hnformatJon Center (ERIC)*, Psychological Ab struts, 

National Technical Information Service (NT IS), government Printing Office 

Monthly Catalog, and MEDLINE. Promising abstracts^ were researched and pertinent 

Information located. Additional materials on hand, in the UM-RRI library were 

a I so rev I ewed . 4 * 4 " 

State Agency Inputs -, - % * ' 

• r ' T 1 . 

In addition-, Inquiries were'made fo each of the 84 state-federal rehab- 

I 

ilitation agencies in the 50 states arfd the territories, regarding instruments 
•actually being used in the state, agencies. Agencies were asked to focus on 
measures of functional I iml tatiorfs, client change, client satisfaction, and 
cMent retention of benefits (follow-up) that had been used recently, were 
currently being used, or were going to be used. Seventy-four' percent of the 

agencies (both genera I , combined, and bl i nd\ ^ponded. , Ninety-nine state 

* * - '* ■* " 

agency-developed instruments were recelvScif In the fol lowing categories: 

Client satisfaction. V . 21 * 

Fo I low-up , 4 

Combination client satisfaction/ . ' ] c m 

follow-up 40 ' , " 



• ^ient 



change . - , . 17/ 

*£y net Tonal 'limitations 11-* 
see I l.eneoys * % ' ^ 



♦ 



Many of these instruments concentrated on the col le'ctlort of data limited to' 



99 



the areas* of client fpl low-up apd satisfaction requested by th£ Federal Evaluation 



'Standards.- Onfy a ^riall portion of. these instruments examined client tunc- 

tloning and how rehab i I i tat ion services- had affected it. * '• •■ 4 

I nstrument Sele ction . ' . * < 

From^.fhe -literature searctf, the' state, .agency input, and the UM-RRI collection 

a forking list of 50 .promi sins measures was compi led to be considered 7 ^ 

Mncli&ton in this monograph, realising that this effort 'represented a beginning 

■ ■ ' * \ / 

. rather than a final point in identifying instruments on rehabi I j tation asseSs- 

merit. Measures were "prcpisjng"' if they had the potential for use instate- 
federal rehabilitation settings for client assessment /and especially if they v 
had potential for use in'program evaluation. Some of these 50 measures were ^ 
later deleted and o'ther^ added; some measures were later found to r be .inappro- 
priate or there was not enough information availably on theSPand some measures 
were located that belonged in this collection of measures. ^Finally 40 measured 
were* selected* for inclusion in the monograph.* - ' %t 

The 40 instruments fall i.nto f I vfe /categories. bf-cbyerage: 

, ^ * Measures of employabi I fty assess factors related'to the ability 
J of a client to obtaifi and maintain 1 employment successfully. < 
t These .-factors may* include physical, intel lectua I ,* psychosocia I , 
• economic/ and environmental areas as wdll as vocational areas / * 

of functioning." ^However, the primary fo,cus js on how these 

factors re J ale to a client's emp loyabi M^y. * ' 

2. Measures of independent living skills assess factors related to 
^ — . the ability of a : 'cli'ent to take v care of his/her own affalrsand 

^ to participate in^sbciety. Areas assessed may include activities, 
of daily living,, self-care} mobility, and psychosocia I wp'll-* ' 
being. Work-related areas -rnay^ be involved but are not tire prim- 
ary focus., ' * . j . * 1 

3. ' Measures of cl lent 'perception include, measures that assess clients' 

vfews, of themselves, the worl^d of woVk, or the ideal job. J 



4. Measures of client sat 1 sYactj on include measures that assess 
clients' satlsf action'"wi th VR serv I ceV; * +ra UXng provided, or ' 

„ - their jdbs. ■ • * 

5. ' Mjscel Janeous measures include those that do not fit neatlyjlnto ♦ 

another category. Jhey may. mix- th# assessment' of emp loyabfP ty 
and independent living ski Ms. or be .appropriate , assessment systems 
for any content 4 area.* ^ > , 



5 

. < 



The 40^measur^s tfary as '.to 'character? sties; measured, clientele for whi.ch; 
intended, origin of deve I opqfehtV 3nd setting of intended use. As mentioned 
'above,' the areas assessed irange from emp Idyabi I ity to independent living skHls 
to client perceptions and satisfaction. In addition-, the instruments were de- 
v&loped.by p&ople in rehabilitation research institutes and centers, uni versitfes,- 
state agencies., rehabilitation facilities, and hospTtals. . Some- were specif i/- 
cally designed for^use in rehab U itation settings, others were not, 'Some . 
serve specific c I tent populations while others are suitable for all VR clients. 
Some are Intended for program evaluation while others ^aVe more appropriately 
use t d.wi : th individual cl tents A IT the counseling process. ' However, they are all f 
measures that could.be used In VR settings. TheFq; delusion in this, monograph v \ 

represents a starting point the* process of helpirfg rehabilitation professionals 
. become more^awan* pf the -diversity of instruments that have been developed ~. 
by research facilities, sta^e agencies, -and practitioners in the field — * 
for/possible use with di sal?led*persons and to encourage the use and further de- 



v^*fopment of appropriate measures in this ffeld. ^ 

This monograph Is not exhaustive in its cbverage of tNe field of rehab i I- 
itation assessment. It does ndt cla4m to ^represent the whole picture, only the 



* best instruments available, or even all of the best instruments available. It 
is a collection of measures that appear iq the literature or in the field that 
-should be considered by rehabi I itat ipn professionals interested in selecting a s 
measure for 1 use or for ihosg interested fn furthering the development of'afssess- 
• # * * ^ment methods in rehabilitation. Rehabi (i faHon prof ess Icfoa Ts themselves must 
p^s judgment on^the appropriateness and*value>of a^gfven instrument jor their 
needs^ , * "* - . - , . * * * 

~" r ™ instrument Summaries •*-/• . - - 

' For each of % th§ 40 measures, included I.n this monograph, a' suenmary^of that 

> * . • ^ / ' • ' * * 

mfeas^e is p ? resentedT . The sumjnary Is a brief account of the measure's charac- 4 



/ 



■J 



1 



teristics and Is designed- to give the reader^ao i dea ; of the'measure so that the 
reader can determine whether it might meet his/her nfeeds.\ In most cases a sample 
9f the instrument litems or the instrument Mtse If is included ^o illustrate 

farther the nature of the* measure. . * * - * * * 1 

* * 

Deve I opment' * * , 5 ^ ' * - 

■ < « » • . * • 

Draft summaries of the selected measures were prepared from the journal 

- ^ • • * ' 

articles and materials on hancl at the UM-RRI. The' summary was iptendjktf a^ a 

discussion of various points about the measure tfiat would be important to po- 
tential users, i.e., coverage, administration and scorj ng' procedures, evidence 
of rel iabi I ifyand val idlty, advantages arfd Limitations, etc. The drafts were 
then sent to developers of the instruments tp con|i*rm the accuracy of the * 

summaries and to fill fn any gaps In the information. The summaries were -then 

m 

final ized, ** ' * t . * K - 

* V,. ' ; . * * ■ 

. Components . . • 4 

-« * / * 

Each of the summaries presented in this monograph contains the following 

elements:" - * p ' 

M. Developer(s) - including a date associated with the measure's 
development - * - 

* * • 2. Purpose t * . 

V 4 ' * * 4 * n 

3. X)escri potion -'including the areqs assessed and the type of^ •* *{ 

I terras used. [ , * - . Y ^ . 

£ „ r 

% 4. Use - Including proposed uses, target populations, and sitings - 
^ for* use ' - 1 - . ** v pV 

5. Administration ' V . 

^ ! * 6. Scoring. * * ; t *V " f 



( 



•7. Reliability "H including, when* avai labte, a descrlptlQrt of the 

type of rel tab! I i4y'or va I tdity exam! ned and the 

8. Validity- I , population on .which the data wer^e gathered. 

* Statements regarding the qua|ity*of the rel iabi I ity 

I an8 validity were based on information obtained 
* * : # from the developers Snd/of^ I i terafure; -they are 

** / ~ m ~ * not the judgments of the UM-RRI; 



J * II References 



9. Advantages "1 .V ^ 

J * r^cbming primarily f rom -f her deye Topers and the 
Limitations I I fterature 



12. AvaUabii i«ty "** * . : " \ ' 4 

' ' * V • ' ' 

' v • apd' In most cases, ' b 1 • • % 

13. Sample Items or fhe> Instrument itself ~ presented* for 
illustratipn purposes only * 

• NOTE: * Pages In this monogra^ containing actual Items from 
Instruments are identif*ed,v/ith- »«*«#«*h#^#**> across 
the top- of the page. - \ • 

Organization of the Monograph J ' % 

The 40 selected measures have been classified according to the five content' 

s « ' « V 

categories discussed earlier In the Selection Process section and their/ summaries 
are presented in the monograph accordingly: -*■ " ^ 

» * • 

1. Measures of emp loyabi 1 1 ty 

2. Measures of Independent living skills C 
K "V 3.* Measures of cl lent -perceptions / 

. „ t 4. Measures of client satisfaction 

5. MIscel laneous measures . • 

WIfhing each fcategory the. instrument summaries appear In*a Iphabetica I order 
by Instrument title. m Indices are also presented by Instrument title and by de- * 
^elopers' 1 names and affiliation In ord6r to facilitate the location*of fhe 'Instru- 
ment summaries In the monograph. , V * * u 
Caution - " * , " . 

As mentioned ^bovQ, the Instrument summary Is Intended to give the reader 
an Idea of what the instrument Is like and whether It- might meet his/her needs* 

It Is not an exhaustive dlscjj^Ion of the measure. To obtain a more complete 
\ * v 4 * 

'understanding of^K particular Instrument, Int£res£ed person^ may consult the s 



i • 



8 ■ * - • . - - , ^ * . r - * 

references cited, obtain* the actual instrument, and/or contact the . developer (s) 
directly.' . 



A. 



' Additional Background 



In ordler *tp* evaluate the information presented in v +he' summaries in the.* 
propeT light, the reader^may be interested in obtaining additional background 



^ information 'on client outcome measurement and technical measurement considerations. 
The reader is referred tp «the reference list. below for additional information 



^fn these areas. 
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ARKANSAS FACILITY OUTGONE MEASURE 



Deve4oper(s) This measure was adapted by the Arkansas Rehabilitation^ 
• . . Services from the CI lent Outcome Measure, also used by 

the Arkansas Rehabilitation Services. The CI lent Outcome 
Measure was adapted'from the Service Outcome Measurement Form, 
original I y, .developed by the Oklahoma Department of RehabiK ' 
, itation and Vikual Services. 



Purpose This measure is designed to assess cli^rchapge as a result 

*b£ participation in rehabilitation fafiilfty services.* 

Description The measure vcons ists of 22 itemaT^hlch are behavioral ly 

' » ■ . anchored on five-point scales. ThereXare three subscales: 

vocational maturity t vocational functioning, and interpersonal 
maturity. Each subscale contains six to ten items. 

Use 4 * The scale can Be used with al i clients in rehabilitation facilities 

- r £x<$ept alcohol programs (see befow regarding an outcome measure f 

. ^ for use in alcohol programs), 1 

The measure is a means of documenting evidence of client gains 
*~ ' m and losses while receiving f aci I i ty s^pvices. It has 'been 
w * used as an established fprmat for formal written reports, $s . 
, V/ - a report completed by evaluators and Instructors, for-compi 1 1 ng 

' a composite reportto the state office, and as an additional 
. ^report to the field counselor working with anient upon % 
completion gf the cl ient's* f aci I ity program. "It alsa has 
P&tential -for use £n planning af tfie state and local I eye I 
.basedyon identified strengths and weaknesses in facility 
programs. . a 

. Variations of the measure have. been used to assess outcome 
y * in a number of other programs in the Arkansas Department of 
-s Social an3 Rehalji I i tatfcve Services: the Rehabilitation Ser- 
t * ' vices Field Client Outcome Measure, the Rehabilitation Ser- 
vices for the Blind Social Services Outcome Measure , and an 
/ . . outcome measure for an alcohol program* . 

Administration. The scale reqy itre^prof ess iona I judgment about the client's 
adjustment. The information required on the form should be 
• readily available to faclMty personnel through daily com- 

• ^ munteation and observation of the client, ht is administered 
within a week of fKe-cllent's admission to the facility and * 
"\ Immediately-prior to the clients dischaVge. It can also be* . - 

v administered at Intermediate points. The assessment of One. 

client takes, abQut five minuted to complete. B • , * 




Scoring " A score Is obtained for each subscafe by summing the ratings 
for the Iterrfe comprising the respective subscales. * 
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Reliability studies were conducted, at a- rehabilitation 
. facili-ty serving the menta I ly* retarded. The raters were 
three counselors,^ counselor aide, and an ev^luator. All ^ 
were given Instruction in the'use of the measdre and were 
familiar with .it. Each $\ ieqt was, rated By "three- raters 
at three points in time: within a week of the client's 
^dmissipn (N = 50); immediately following the client's first , 
staff ing, approximately six weeks after admission (N = 44); . 
and immediately pribr to the client's discharge (N = 26). 
. Therefore, three interrater reliability estimates were 
calculated W each subscale. Rei.iabi I itv* estimates were 
low at admission fcntf'Yix weeks later (.49 to .54) and hiaher 
at discharge (.79 to, .80). The >U>w inffial estimates make 
it impossible to assess>gain reliability. These results 
indicate that the interrater reliability of the rating ' 
procedure needs improvement*. ' , 

Internal- consistency and item subscale correlations were also' v 
calculated. Internal consistency coefficients were generally 
hi,gh (the coefficient alphas based on aj I observations by 
, a I J raters at all times were .89, Vocational Functioning;* 
>>.§6, Vocatiorial Maturity; and .88, Interpersonal Maturity'). 
■ The correlations bf the component items with +he correspond- 
, i\igsjbs9aTe were also high (.70 to .82; Vocational Function- 
ing; .72 to .87, Vocational Maturity; and .54 to .81, Inter- 
personal/Maturity). The three subscales w,ere also highly 
correlated (.85 to .86). * * 

* \ • 

'No evideice of validity was presented in, the maferfate reviewed. 

This measure provides pre- and .p*ost-mea£ures q>f the client and 
has potential as a meajis. of monitoring client progress. Also, 
^ administration of the measure does not trfke long. :< - 

* • * ■ ' * • ' • ■ ■ T 

lhterrater T rel iabi i ity needs' to be/improvey and evidence of 
va I i d J ty presented . ' 

Bolton, B. Client and counselor per$pecTW€^ 
9 ment'of c I ierft- adjustment. Rehab i 1 1 tat ion Counsel ing- Bui let In, 
June^ 1978, 2^ (4),' 282-288.. N 

Cooper,. P. G. * The efssessroenf df rehabilitation faci 1 1 ty service* 
ki Arkap§Z}s . Fayettevi \ le, f Arkansas: Arkansas 4 Rehabi I Itation 
Research and^Training Center, 1976. , 

Kemp, G. Progress report on client outcome measures in facility 
programs . Little Roqk, Arkansas: -Department of Social and" 
RehabilltgtlVe Services, State of Arkahsas, 1974. 
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* * * 

A ! I ml fed number of tfie FacTl Ity and Field Client Outcome 
Measures are available from. ^~ *~ 

Program PJanning and Evaluation 

Department of Human Services. Rehab i II tat ion Services 
1 40 1 ferookwopd Drive ^ 
t> P.O. Box 3781 

Little Rock, Arkansas 72503 
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✓ 

ARKANSAS FACILITY OUTCOME MEASURE' 

I. .Vocational Maturity 

A. Teanrrwork 

1. Is unable to work effectively with any others. 

2. Can work wi^h only one or -two others whom §re*particu lanUy liked. 

3. Can usually work with a few others without conflict. ^ 

4. ^ Works effectively In s>nall (2-3) groups. ' 0 * 
^ .5. Is a good tdam worker In af?¥y group. 

B. Work Endurance 

I. -Leaves work station frequently and gives up Easily on job assignments 
. ♦ 2 * Works borderline minimum time on job assignments* 

3. Usually works on job assignments for acceptable length of time but 
occasionally does not finish work or leaves work station. 

4. Works on job assignments fd/acceptab le lengths of time without 
Interruption. / 

5. Exceeds work requirements fbr time spent on .job assignments. Works 
until assignment is completed.^ " - 

* <♦ 

• * C. ; Work Attitude ^ 

- - . Rebellious - refuses altogether t© do assigned tasks., 
j 2. Indifferent -* wf!l do assigned tasH^reluctantly. ' X 

3 - Acceptable - shows signs of interest and will perform 
assigned tasks. 

4. Appropriate - approach is positive and well motivated toward task. 

5. ^Exceptional - approach is strongly positive and considerably higher 
, thart no rmaJ I y expected . 



^ "U. Vocational Functioning ^ 
\ C r . Safety Habits 

♦ ■ Does not recognize, or disregards safety habits. ' K 

, 2. Sometimes practices appropriate safety habits.* 

3. Understands and genera I I y f o I lows most. safety procedures. . • 

4. Accepts, understands, and follows Instructions relating to 
safety processes. . ~ m % '.^ 

'5. Observant In recognizing danger and, assists otheVs to follow*^ 
• * safety procedures In a I HcWrcumstances . . ' 



D. Client's Communication In W6rk , Setting 

I. (tanmunlcates with great difficulty. 
• 2.. MIsimal level of communication. 
3.' Copnunlcatldn generally Acceptable for the most part. 
* * 4C- Communicates clearly and wlth*understandlng. 

* 5.. Exceptionally clear, bas ability, to communicate at different levels, 

MI. Interpersonal ^Maturity * ^ 4 

A. Participation In Group Soctij Activities * , 

I. Lack of participation In social activities or participates to such 
.a degree that It becomes disruptive. 
; \ 1 2. Generally Isolates self from social activities* t ' 

3. -'Passive participant - mainly a listener but remains part "of "the • 
^ s pc I a I . group. % | 
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A. Participation I / Group S^ci a I Activities, (cont. ) 

4. * Active parMcippnt irl socia I activities. 

5. Accepted afe a leader and \s center of social activities. 

B. Extent Client Seeks Assistance, \ 

' I. Constantly demands hejp and attention wffen unnecessary. 

2. Continues wortyng instead of, asking for* sss i stance when unsure 
if the job -is being done correctly. ' 

3. ^ Occasional ly needs he^lp a.nd^asks for it. 

^4. Generally handles own problems.' ^ - , 

5. Rarely seeks assistance, shows exceptional insight into solving 
problems. ' * • 

I. Realism of Job Goals 4 . ^ * 

1. Does not have plans for a job and has not considered any. 

2. Considers job plans but are unrealistic and^not compatible with 
abilities. 

3. Has begun to think about possible occupations that are within * 
capabl I itles. 

4. Accepts guidance in planning for future jobs, realizing limitations. 

5. Has developed realistic job goals an* seeks counsel In planning. 

J. Confidence in Self as a Worker f 

1. Does not* see self as being able to hold a job. 

2. <Excessively timid or shows unimpressive over-cop f idence. 
^ae-le capable *of being an adequate employe^. 

Fee Is t capable of being a good employee. 

Highly favorable, client's sel f-conf idence" inspires confidence from 
others. J 



t 



luced by permission t>f the State of Arkansas'Di.vision of- Rehabi Utatlon 



22. 



Services, 



18' 



BEHAVIOR CHEbKUST 



Developer(s) 



Jhe Behavior Check I fst was developed for use at the Kansas 
Vocationa I 'RehabJ I itation .Center as part of an assessment 
package v6r evaluating clients at that state facility. The 
latest revisions were made in 1981. 



Purpose 



This measure is designed to assess clients 
selected work behaviors. 



i n 



f aci I i ties on 



Description 



Us-e 



Administration 



Scoring ' 

Rel iabi I ity 
Val idity 
Advantages 



Limitations 



References 



This measure* consists, of 19 items addressing important work 
behaviors, jncl udingj dependabi I ity, supervision, acceptance 
of task, steadiness of work, *commun iqat ion, confidence, 
interaction with»other clients, and hygiene. Many items are 
multi-point scales with, three to five rating choices and 
additional fill-in ^pace for further information. Additional 
open-ended items complete the mea'sure. - ' 

The measure is designed for use with clients in' rehabi I itation 
facilities. Results can provide a' one-time assessment of 
the client's work behaviors, or time interval evidence of 
progress or lack of progress in a work setting. 

The Behavior Checkl i st is completed by a facility staff person^ 
who is familiar (thrqugh frequent direct observation for 
5-10 days) with the cliept's behavior "on-the-job. 11 The, 
measure should be. administered. after the completion of -a , 

1- 2 week shdrt-terffTprogram in a facility or af\ internal s of 

2- 4 weeks H the client is in a longer term program, the/ 
actual rat i ng^tafces about 10-15 minutes- to compjelie. 

' \ 

A scoring system is still /being developed for the Behavior 
Checkl 1st . *lt is a hand-scorable instrument. 

Reliability studies have-not yet. been conducted. 

Validity studies have not yet been conducted. f * 

First, the measure provides a- large amount of information 
on work behaviprs with'minimunrstaff time necessary for 
write-up/ Sedond,^the same behaviors are rated bn all clients. 
Third, space is provided for further comment and! clarifica- 
tion of/the rated behaviors. 1 

There is ho formalized scori n^system presently available 
w!/hh evidence of reliability and validity. Also,. rater vari- 
ability is a problem. , 



Kansas Vocational "Rehabi I itation Center. 
s Sel1na, Kansas: Author, 1 98 J • 



Behavior checklist 
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A. 



Availability Single copies can.be obtained b^ writing to. - — 



Chief ^valuator 

Kansas Vocational Rehabilitation Center 
3140, Centennial Road 
Salina, KS 67401 
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20 • ( 4 • : " SAMPLE ITEMS - 



BEHAV I OR £HECKL 1ST * ■ % . - j| 



CHent^ajte; ; Completed by: : , [ . 

-(I) * Dependability: . ' ° ' v r s 

(a) Punctuality' (In reporting In mdrnlng and from breaks); ' ' 

Number of time's late, ^ s Number unexcused « J* 
. , (b) Attendance ' . * -„ 

*• . Tota-I days absent Number^unexcused > . 

J Comments % ' * . . , 



(2,) v Extra breaks from work * ' • • . " ' 

/ . * (a) Client did not take extra breaks. ' 

* '— (b) Client occasionally left the shop other than at*brea'k time: r 

1 ' ix.* Average 'times per day ; ] - Average time gone * 

j (<r) • Client took frequent breaks; % ' * 

- Average times per day . , Average time gone x ' ' . * 

' • * - . - *% 

( ?> Amount of* supervision required after task was starte.d * - 

(a) Client needed almost no assistance and was able to go ahead^t 

his/her own pace . » 

(b) Client needed occasional assistance/approval and/or prodding to 

cor^*Jnue on task 

(c) Client needed almost constant support/assistance and/dr prodding 

to start or continue working * . * 

* * • • * 

(4) Acceptance of supervisor/supervisory role: 

^ (a) Client was usually comfortab \eiar\d appropriate In accepting supervision 

-fe Cb) Client was anxious with supervisor 

^(c) CI lent occasional ly resisted Instructions/requests or was Inappro- 

prlafe with supervisory 
(d) Client frequently refused to accept supervisor's Instructions/re- 
quests (did task own, way) 

(5) ^ Requests for assistance from evajuator , f ^ 
! , (a ! J Client made appropriate requests for assistance" 

x „ . : (b) ,Cllent occasionally did not, ask for needfed help % . 

- (c) Client occaslona My. asked unnecessary questions * 

(d) Client made many unnecessary requests for help 

; (e) CI lent' hardly ever asked for assistance, even though he/she did ' . 

not understand how to carry put a task , • ' 



,(6) Recognition of mistakes ' B * - 

1 (a) Client caught most mistakes and made corrections V 

_____ <b> Client made "careless 11 errors that. were not caught 

. (c) Client mlssfed even gross'errors made (e,&. L ^ 

p (d) Client recognized own mistakes but % \ \ ~ , 

> (I). Became agitated 

Blamed .others or circumstanced r " ; 



' ( III) Othar 

? 
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. • * 



' (7) 



(8) 



<9> 



9 * 



Reaction to correction/suggestions for performance improvement ' 

(a) Client's performance Improved after correction/suggestion 

(b) ^ Client accepted correction and improved performance, .but needed 

this done in supportivfe manner- " . 

(c) .Correction/suggestions dfd not change cl lent f s -performance 

(d) ^Client's performance became woVse after correction?". Exp I a In: ■ 
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Acceptance of task 




"|^Ja ( fnetf ' x m6/oj^^f^^^^^^k on* ass i gned' 

. - \ -> \ v'. [ ^>kr ■ .... : 



' Steadiness of work/dis4,racta6l li ty <1; T • 's;' r ' . *'< \ 

_ (a) Client wa^ppt di^tractd^^rbm'a^signed task * 
_ (b.V CI ient~was"^c y ^^ nofses or other 

m .envlronmenta^^^tor^v^'i,/ s u *- 
_ (c) Clierrt oftQn* r ^ ' * 
(d > CrtJent/esHty.distra^^ tasks / 

(1.0) ^^l^^^^^^^^^L- ' * * ' / 

f . <- a ^ " ^^^P^^P^^^^^^t 0 . commun 1 cate tights and ideas effectively 

CfltSW ' H^d % ^^m^ff I cu I ty ? in cb^munj eating thoughts/ i deas,/ but 

was : able to^^t^!|^hem known ' * < . - / 
* (c) Client had*^c6f%^catIon\habit that could present problems/ on a 

job. Speci fy : ' ^ . ' ^ L 




^CLl ENT 'HANDICAP -CHECKLIST (CHC) 



The- 6HC was developed by the University of* Wisconsin Reglorteh 
Rehabilitation Research Institute (OW7RRRI ) In 1973 as part of~the 
* Concentrated tesessment and Diagnosis In Rehabilitation :> — ^ \ 
Entrance (CADRE) Project, a program evaluation effort conducted 
by the. UW-RRR I, the Wisconsin Division, of Vocational RehaBl H- . 
tation/and. t.he Waukesha, Wisconsin, OVR district office*- 



CHC I.s an Instrument -used to assess client functioning-. 



% . The CHC contains 21. Items/ each, Item consisting of a f Ive- 

pafnt. rating scale assessing the degree of handicap that exists'. 
Four* dtsf Inct areas of client functioning, and potential voca- " 
tlbna I ly^handl capplpg conditions, are .Investigated: H attitude * 
„ and personafy-y handicaps', vocatlona I "maturity handicaps, 

jobrseeklng handicaps, and related vocational handicaps. V . ' . 

The CHC was designed for use with all clients seeking services, * 
from the. state-federa I vocational rehab! I itaj^Ion 'program. ^ It 

\ Is^us'eful to both case managers and program managers.. „ lt*j£lal*\ 
.assessment h6Js&s case "managers, and client* tn identifying t , 
Voca-tlpnal handicaps, which Is an essential step in establishing 
reallst+c vocational ^oa|s and developing relevant rehabilitation 
plans. . It^fielps to\l nsur e a , systematic cCncenn forj^ varJ-ety 
of vocaf ^0r^^ 1 1 y h^hdrfc^ping conditions*. I ntej^iedTate eva ( ua- 
tlpn;s prove usefuf In assessing the,.- c I lent* s progress and, the 
lef fectt v^ness of the. program. Evaluation at closure Js bene-x \ 
flclal In providing an Indication of client change as a result 
of p&rtjclpatl ng In the prograrfc aftd thus a meaSufce of the Impact 

^ s -of the program, and In- he^Dlng to determine placement suit- 
ability, and program effectiveness.* v • 

f » 

The Instrument Is Intended to to administered by therahabm- * 
. tatlo.n counselor, and relies on professional judgment. It * 
has been admlnTsterSd at different times throughout the VR- 
proqess (e.g., Initiation of services,- .after precision of* * 4 
services^ and at closure),. It Is* also recommended for use 
dtfr tng, follow-up. ~ A brief ^tra I n I ng spssJon *ji\the CHC y s » - - 
u$§*and strict adherence to the Instructions are recomnandad 
t to he\\> Insure the^ad*equate reliability of the information/ 
Information Is generated by interviewing the client and 
\revlewfhg 'case reporcte* Once'the rehabilitation counselor 
* has* the diagnostic evaluation Information aval lab le,< th$ In- 
strument can- be completed In apgftpximately^S-IO minutes. 

& K s ^ ' * * . ^ ' fig « * * ■ t ' 

The CHC is not'a tridimensional measure. Thus*,' no single 
scfore Is yielded. Is simply a surrfmary of *fhe degree to 
. "wMch certain functional limitations ar§ handicapping. „ * 
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Reliability There Is no, statist I ca T evidence fpr the measure's reliability. 

•However, a' brief training session In Its use -for those who wt I I 
. v . 6© using It I$^ecomrj0nded. to help Insure adequate reliability. 

Validity .' • Ihere; Is no statistical evidence for the measured validity. 

^ ' However, content and construct validity are supporfed by the 
' . fact that the measure was developed by experts In' rehabilitation 

£ - w ' + h Input from /praqticing rehabilitation counselors. % v 

- - ? 0 • " ' , x< 

Advantages Same "advantages of the Instruct Include vthe foJ lowing; Areas 

Investigated^ are broad enough to assess relevant aspects- of £ 
■ % , " the rehabilitation ppoce'ss (I.e., numerous conditions or sit- 

uations whteh may encourage or dllcourage reftSbt 1 1 tat I on efforts); 
and It Is contained enough to allow rehabilitation counselors 
* • to be able to complete It In. a ml n I ma I ^amount of time. r # 

/ \ 

Limitations A major disadvantage Is fhe assessment of rather ambiguous * 

characteristics (e.g., motivation for rehabilitation services / 
t * relies heavily on counselor judgment) , t 

References m 1 CADRE Project. CADRE project client handicap checklist and 

administrative I nstructfon$ . Madison, Wisconsin: University of 
P Wisconsin Regional Rehabilitation Research Institute' 1975. - 

< * - Crystal, R. M., Growlck, B. S., & Rayford, C. J. Concentrated 

assessment and diagnosis in rehabilitation entrance. Jotirna I 
of Rehabilitation, 1980, 46 (3), 33-35. 

Crystal^ R. M/, Growick, B. S., & Rayford, ?! J; Concentrated ■ 
assessment and diagnosis in rehabilitation entrance: Research 
report . Madison, Wisconsin: University of Wisconsin Regional 
Rehabilitation Research Institute, 1977. - * ■ . 

*> ...» 

Availability Single copies of the bHC can be obtained from % 

V ; ; • Ralph M. Crystal, Director \ '* , 

Graduate Program In Rehabilitation* 

Counsel ing + . 

' University of Kentucky 

* "T24 TayTpF Education Bui I ding % - 

y Lexington, Ky 40506 



, SAMPLE-ITEMS • 4 . ' ' * . / • *" 



"Xjli-ent handicap checklist 





- . Degree of Handicap • . 




0.= 


No^ information available 




1 = 


Not a problem 




z = 


Mild 


Client Handicap Categories 

* * > 
(see CADRE Project Manual for Definitions) 


, 3 = 
4 = 


Moderate 
Severe 



\% AttLfude and Personality handicaps 
'a; Perception of self 

*» 

2* Vocational Maturity Handicaps 

a) * Establishment of rea llstjyp: vocationa I 

■ 30a Is - * . ' t 

3. Job Seeking Ski Ms' . x * 

b) Realistic knowledge of^job require- 
ments 

4. Related Vocational Handicaps* 
a) Transportation 



Circle Desired Response 
) I 2 3 ' ^ 



.1 



0 * I 
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EMPLOYER! QUESTIONNAIRES OF THE WEST VIRGINIA FOLLOW-UP KIT 




Description 



Use 



Administration 



The, Employer Quests onna I ng was developed at the 
Rehabilitation Research and' Training Center In 1974 



Jest 



Virginia 



The. Employer. Questionnaire Is a follow-up Instrument designed 
to assess employer/supervisor* satisfaction with employees 
.(former rehabl I Itatlon c| lents) • 

The Instrument ha^ two subset I es and a total of 21 forced, 
choice ltem$l A) I Items of the Employer Questionnaire are 
- Identical or similar to Items In the Employee Questionnaire , 
The flrSt subscaJe, ' the Tseng Work Personality Subscale (items 
3-13, and Item§ ~J^£6 of the' . Employee Questionnaire ). Is a 
;-^summatlve rating scale which yields a glpba I /fneasure bf the 
^employer/supervisor's assessment of the employee's personal 
qualities In The work situation. The following attributes 
are assessed: ability to work with others, punctuality, 
cooperatIvefie£s, a " self-reliance, appearance, courtesy, "motivation 
reliability, work tolerance/ Initiative, and attitude towards 
J ob * , * . ' 

The Tseng \fork Proficiency Sujbscale (Items 14-19, and Items 
16-26 of. the Employee, Questionnaire ) Is a summatjve rating 
scale wh*tch provides a measure of the employer/supervisor's 
assessment, of the employee's work proficiency*. Work pro- 
ficiency is assessed a-Iong the following attributes: job 
^ " knowledge, job ski I Is, qua I fty of work, care and operation 
of equipment, b^s^rvance of safety,( practices, and compliance 
with work rules, ' - 

' Additional 'Item's on the client's job title, <n umber of hours 
worked* per week, overall performance, ahd the Importance of 
*' rehabilitation services on emp loyee ^performance make up the 
rest of Jhe^questionnal re A ' 

4 t * f 

The roa jor;ity of the J terns are mu)4l-polnt ratings (e.g. agree/ 
disagree) on a five-point, sea I a/where In ^represents the lowest 
rating and 5 represents the highest." 

> The Instrument Is appropriate for employers of all former 
rehabilitation o\ lents, and It was developed for use In the 

. state-federal rehabl I) tat I pn_ system. The Employer Questionnaire 
\ ls 4 beneflclaL to bo+h case- managers- and program managers. % 

information can be generated'on the types of businesses hiring - 
former rehabilitation clients, job classifications of those 
hlred> s pnd *the employer's assessment of era^loyees 1 work person- 

* altty ah< work, prof Iclency. This can be used to document the 

, success oKfehabl I Itatlon programs. These data ard sflso bene- 
ficial *Ia "pfenning and ro^^acjLng services. 

The Employer Que'dtlonna I re I5 a self-report Instrument which - 
W ajdrrif nlstered after cfpsury.' It Is recommended that the 
admlfifstfat-lon occur at least one year after the client/employee 



case Is' closed 'so as to obtain a measure of the lasting 
impact Qf rehabilitation services. The Instrument is mailed 
to employers and they are instructed to- cdmplete and return 
them. ..vThe instrument can be completed in approximately IJ5 
minutes. . 9 . 

The Employer, Questionnaire data can "be compiled in two wa'^s: 
one for computer analysis and the other for- hand or machine 
calculation. Either m^fhod" uses the computations of 'totals, 
frequencies, averages, -percents, .and standard deviation. 
(Forms<,for complllnq the data can be made from'the sample for 
use with the Employee Quest lonnai re * that Is Included in the 
Follow-up Kit.) If computer services are available, corre- 
lational analysis, t-tests, and analysis of variance may be 
used to strengthen evaluation reports. ' - 

Composite scores, for work personality and wprk proficiency 
are obtained by counting and then averaging all attributes 
associated with the particular factor. Then by adding the 
averages -for the attributes, a composite score is derived. 
This permits comparisons of employer assessments and employee 
assessments (using the Employee Questionnaire also Included* 
ijv the Fo I low-up Kit }, as well as comparIsons k of employer" 
assessments differentiated by various factors (e.g., type of 
business, closure 1 status of clients, disability class! fF 
tion of clfepts, etc.). 

Reliability data are available for the two subscales: 

The Tseng Work Personality Subfftele (items 3-13 on He 
Employer Questionnaire ) has thejfe>lit half reliability with 
the Spearman-Brown correction of .94 (Nf = U4h The Tseng Work 
Proficiency StibscaJe (items 14-19 on the Employer Questionnaire ) 
has the split-half reliability with the Spearman-Brown correction 
of .94 (N^ = 114). The combined Tseng scales have the split-half 
reliability corrected by th& Spearman-Brown formula of* .95. 
(N = 1 14). 

The Internal consistency of the Tseng Work Personality Subscale, 
as measctred by Cronbach f s alpha, Is .9*1 CN - '1 J4)._The Internal 
consistency of < the Tseng Work Proficiency Subscale,*as measured* 
by Cr<^nbach T s alpha, Is .89 (N =, 114). The combined Tseng 
scajes" have the Internal consistency, as measured by Cronbach's 
jklpha, of.. 94 (N = 114)* 
J* 

Evidence of validity Is not available. / 

3<5me c$f the advantages of the Instrument include ^he following: 
ft Is self-administered; Jt taps employer satisfaction^ the 
most impofflsnt factor In job maintenance; comparlsonsWf - employee 
and employer perceptions can be accomplished. 

A major limitation Is that since no ^e-measure is possible, . 
It Is more .difficult to view the client/employee performance 
£s the result of rehabl Mta+Ion services. Also, evidence of 
val Id! iy~ heeds id be oomplled. ^ 
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Greev^r, K;B.,' Minton, E. B., 4 Tseng, M. S. Pol low-up 
study of rehabilitation cl.tents - a step-by-step guide , 
'Institute, Wes-K Virginia: Research an<KTra I nlng Center, 1974. 

The West Virginia Fo Mow-up Kit, Including the Employer Ques- 
tionnaire and the Empjoyee Questionnaire, can be obtained from 

* Publications Department 
- West Virginia RetiabI I f tat Ion 
Research and Training Center 
/ A 9 One/ Dunbar Plaza, Suite E »- * * 

'Dunbar, WV 25064 

S 

In addl+ion to the questionnaires mentioned above, the Follow- 
up Kit gonterins information on planning and conducting a fdlJow 
up study, sampling, analyzing the data, and writing the report... 
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. SAMPLE ITEMS 
EMPLOYER ^UEST I ONNA I RE 



i 



Items 3 through 21 *ar3 statements about this employee and his (or her )* performance. 
PJease read each staement carefully and circle ONE o$ the provided answers which 
Indicates how much you agree or disagree wlth'thfc. item.. 

• /*-" . •'. • ■ •"' • 

3.( The employee does not have trouble with his/her co^worked;, * - 
■ \ , ^ . * - * ' ' 

\I. ^Strongly agree " ' ._ ' ' 

2. Agree - 1 •* 

1 3. ' Uncertain • " , • 4 . , 

4. DIsagnbS* § - ~ 

5. Strongly disagree / 

4. The employee comes to work on time "and returns from breads on, time', 
I. Strongly agree \ 



< * 



2. Agree 

3. Uncertain 

4. Disagree 

5. Strongly disagree 



r 



5. The employee gets along well with the supervisor. 

fc. Strongly agree 

2. Agree * 

* 3. Uncertain / . " ^ 

4. Disagree, | 1 a 

5. Strongly disagree 

# 6. The empl6yee get work done without being told by the supervisor. 

■ f l. Strongly, agree' v 

> m 2. Agree 

3, Uncertain ;" 

4'. Disagree " • ' ' / /> 

* 5. Stssongly disagree' 

7; ? The employee t/des to -look his/her best, when he/she Is doing his/her job. 
I. Strongly agree * v 

2: ^ Agrees ; — , V ' ^ • : c 

3. Uncertain ' * * 

4. Disagree ^ -y f 

5. Strongly disagree ' 

14. The. employee*^ knowledge about h I s/h^r job Is 

I. "Very good f lfc . 

* 2. * Good * - ; f ; ' ~ ' . * * - \ ^ 

3. ^Fafr \ 

4. Poor * * w v * * - % . , # 

'5* Very poor. • * 4 s * ? 
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15. The employee's work skill in the trade Is 

^ * • 

1. Very good 

2- Good • 1 

3. Fair } 

4. Poor 

5. Very Poor i , 

16. The quajity of the employee 1 s work is * 

I • Very good J 

2. Good 
* 3. Fair 

4. Poor 
5,. Very poor 

17. The employee's operation and care of equipment are 

1 . Very good ) 
' 2. Good - 

3. Fair 

4. Poor 

5. Very poor * - • 

* • t 

21. The employees training through Vocatlona I* RehabI I i tation Is^important to 
his/her job peVformance. - + 

I * Strongly agree , 

2. Agree 

3. Uncertain 

4. Disagree * ' 

5. ' Strong l*y disagree _f 
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/: * Reproduced by permission of the West Virginia Rehabilitation Research and Trairrinq 
q Center, %\ . 



FUNCTIONAL ASSESSMENT INVENTORY (FAD 

The FA I was developed by Nancy M. Crewe and Gary ^ Athelstan 
at the- University of Minnesota f s Department of Physical- 
Medicine and Rehabilitation and copyrighted in 1980. 
* \ 

The JAl provides an assessment of an individual T s capacity for 
work or other productive activity. It is intended to organize 
ana focus work-related information rather than generate new 
daya about the client; Therefore, it will draw upon and not 
reAlgce interviewing, psychometric testing, and work Evaluation*, 

■The FAI consists of 42 Items'U.e., 30 four-point functional* 
I imitation* items, a 10-item checklist of assets or unusuah- 

..strengths, on§ scale of the counselors assessment of seveVity 
of disability, and one scale .pf the counselors prediction'^f 
employabi I ity). Areas investigated included the following: 
sensory, motor; psychological j intellectual, sbcia I , biograph- 
ical, *and environmental. The 30 four-point functional limita- 
tion items are behavioral ly anchored and selected for their „ 
vocational relevance. Each itefo ranges from zero to three, 
representing no impairment, mild, moderate, and severe impair- 
ment, respectively. The presence of any of the 10 strength 
itemfe (e.g., verbal fluency) is sfeen as a moderator variable 

'that may mrfigate'the impact of functional. I imitations on the . 
employment potential of disabled iridividuals. The severity of 
disability scale is a seven-point rating scale ranging from 
I, minimally disabled, to 7, veryseverely disabled. The 
employabi I ity scale (i.e., vocational potential) is a four- 
point rating scale ranging from I, poor chance of client 
ever working, to 4, excellent chance of client working. The 
items take into account the environment in which the client 
must function as well as characteristics of the particular 
individual. 

The FAI seems appropriate for all clients and particularly N 
for severely handicapped cli'ents. It would be useful in 
state-federal VRS, rehabilitation facilities, and other * 
settings. ' * 

The FAI will be beneficial to various professionals in the ^ 
rehabilitation field. Case managers will 6e able to use the 
' FAI to Identify strength^ and limitations of their clients In 
order to ensure that al I relevant problems are considered 
prfor to selection' of • a vocational CficHce and that potential 
disruptive barriers are gTven special attention in the place- 
ment process. Program managers and researchers wJ 1 1 be*able** 
to use*the FAI to provlde^an objective basis for definition 
of severe disability aftd enable classification of clients, 
according to degrees of severity for program evaluation and 
research purposes, / 
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1* 

The FAl may also be useful In assessing functional limitations 
as an aid in training^ experienced counselors to work with 
• Jseverely disabled client^. The Inventory seems useful in . 
enabling stOdents and new counselors to identify specific 
components and to find a starting point for counselor ihter- 
« vent I on • % ~ ^ 

A V Administration Administration of the FAl requires professional judgment. 

The e valuator would need to consider various sources of 
/^information (e.g., client report,, observation; work evalua- 
tion,' physiological/psychological eval uations,' etc. ) i,n % • 
making/this judgment. Space is provided for checking those 
* I imitations that could be reduced through the provision of 
rehabilitation services. The assessment would be appropriate 
soon .after the client is 'admitted to service in an effort 
to make* real istic and complete plans. It could also be used * 
| ^ during termination of. service to make more suitable plac£- 

1 ments. The time required to complete the FAl is* approximately 

5-^10 minutes. 

* * * k V * 

Scoring ' * A total Functional Limitation (FL) score can be determined 
, ( fc>y simply adding thera* ratings fon<each item. Similarly, 

scale scores can" be obtained by adding the ratings on a I I 
of the items with in' a given scate. Th$ instrument can be 
* scored by handi 

« ^ Rel Iabi I ity The FAl was subjected to testing of Interrater $el iabi I it^. 

An initial Series of rnterviews was observed by varying ^airs 
*' of counseling psychologists, and the FAl was completed by 

each observer.^ Agreement between raters was checked and 
discrepancies examfned* Coding conventions were revised as 
m necessary. 'Next, a series of 25 Interviews was observed and 

rated by pairs of psychologists,, but' the ratings were not 
► ' discussed. This series showed that J5% of the ratings made 

by the pairs of observers were identical. Only 3% of the 
ratings differed by more than one point on a four-ipolnt scale. • 
As, a result of this work, several ItSms were revised and one 
' Item was added. A third series of 12 clients was then rated 



- / 



w?th_ sl-m! lartresults.. Therefore, the reliability of the 
instrument was judged to be satisfactory. 
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Validity # 0ver a nl'he'-month period counselors completed the FAl on ne\f~ 

clien/s CN = 351) as they were accepted for seFvices. Sub- 
jects were' divided into eight groups* according to their 
primary disability and frequency distributions were d,rawn 
for each item. Factor analysis of the Functional Limitation 
(FL) ItemS^ras carried out to provided basis for Identifying 
\ , underlying scales. Jhe procedure vjas completed first 'oa 

\ <r . the total sample of 351 subjects and. then repeated separately 

\J for 173 clients with a primary diagnosis of physical disability^ 

and then for the 152 with a primary dlagnfosls of behavioral 
disability. The strength Items were* emitted from factor 
e analysis since they were not scaled -In the same way as the FL * * 

•* Jtems,. 'The distribution of responses for each FL Item reveals t 
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Joglcal ^dffferfnces in ratings between disability groups. 

Concurrent and predict ive va I Id ity are being developed for 
the FA I . Concurrent validity is reflected in^the correla- 
tron^between couns^Jpr assessment of severity of disability « 
and emp loyabi I ity and the total FL score and number of strength 
iPearson correlations between each of * these tounselor 
ratings and total FL Item scores and total strength score? 

.were cajculated for the total group of 351 subjects s mentioned 
above as well as for the subgroups of physical (N_ = 173) and 
behavioral ( H = 152) disabilities. For all subjects the 
correlation between total FL scores and Predict ion. of Employ- 
ability was ,-.61. The # correlation between total FL scores 
and Severity of pi sab Tl ity was ;60." Among physically disabled 
clients 'the correlations between the tota^ FL scores and the 
two*ratings were -.60 and .60, respectively. Among behavior- 
ally disabled cJients the correlations were -.64 and .60) 
respectively. All of the correlations were statistical ly 4 

'significant at the .001 of probability. 



The correlations between total strength item score's and the 
two counselor ratings wer©--somewhat lower but still statisti- 
cally significant. They were, of course, in the opposite 
direction of the correlations with the total R. scores. , For 
all subjects the correlation -between the total Sfrength score 
and Emp loyabi I ity was .53, and with ^Severity of Disability 
it was -.21. For physically disabled subjects the correla- 
tions were .52 and -.30, respectively. / 

Pearson correlations between the two. glottal ratings of Pre- 
diction of Employabi I Ity and Severity of HDisabi I ity were also 
calculated for all 351 subjects and for the subgroups of 
physical* 'and behavioral disabilities.* For the total group 
correlation was -.51. For clients with physical/ disabi I itles 
the rating of Prediction of Emp loyabi I ity correlated -.56 with 
the rating of Severity of Disability. For c/ients with behav- 
ioral diagnoses the correlation between the^ two ratings was 
~.*5Z. These correlations were all statistical 1^ sign! f icant 
at the_,00l J eye f of probability. 

■ 4 

Predictive validity Is ba^ed on the relationship between FL 
scores and strength scores and actual vocational outcome.. 
However^this garf of the validation proc^ss wi I I not be 
completed unfTPafl of the follow-up data have been obtained 
through the central files of 4*he Minnesota DVR office. 

Expanded -field testing Is'now underway In other states, and" 
norms are being developed. » 

# a * 

The FA I Js .brief, yet comprehensive. It provides a basis for 
structuring the Initial Interview and (paking a vocational 
diagnosis. When the FA I Is used with' the Personal Capacities 
Questionnaire * (discussed below), counselor and client perceptic 
of functional capacities can be compared. 
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The Personal Capacities Questionnaife '(PCp) \9 an^item-bv- 
Ptem translatlqn of the FAI that Is designed°to be comp leted ' 
.by clients themselves rather, than by counselors/ the advant- 
age of the PCQ 'is that it provides -counselors with direct 
■Information about how the client sees his/her limitations and 
strengths in 40 work-related areas. Thls'could provide infor- 
mation about p/qblems that would otherwise have been overlooked, 

* * 


* 
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Field' tests of the-f&g, used jointly with the FAI_ are beina 
planned.' The relationship between PCQ scores and rehabilitation 
outcomes will be examined and norms established. Scales will * 
also be 'identified, and the correlations between the FAI and PCQ 
calculated. Until then the information obtained frorn^ the PCQ 
can be used as information gathered through the Interviewing 
process would. 


* 
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Limitations 
References 


Both the FAI and tfhe PCO are avaMable In bra I 1 le and large- 
1 print editions. • * 

. / 

Normative and validation data on the FAI are not yet complete. 

Crewe, N. M. &. % Athe 1 stan, G. T. The functional assessment 
inventory: Field-test results and further^development. 
Unpublished manuscript. (Available from the first author). « 


* 






k Crewe, N. M., Athelstan, G. T., and Meadows, G. K. Vocational 
diagnosis through assessment of functional limitations. 
Archives of Physical Medi.cine and Rehab? 1 itation, 1975, 56, 
513-516.. 
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Availability 

i 


Copies of the FA 1 , the PCO, and other perti n^nt i n format Ion can 
.be obtained fropf^ — . 
<^ » . ■ * 
.Nancy «. Crewe, Ph.'D. § 
f ^ # Dept. of Physical Medicme and Rehabilitation 
860 M3yo Memorial Building,- Box 297 
University of Minnesota jHpspita Is 
420 Delaware St., SE^ 

* » * ' Minneapolis, MN 554,55 

• * 
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SAMPLE ITEMS 



FUNCTIONAL ASSESSMENT INVENTORY 




1. Vision (See Instructions.) * • • 
0. *No' sign I flc^nt Impairment. 

f l. Has difficulty handling work Involving fine visuaCdeta i I . 

2. Impairment Is sufficient to Interfere with major activities such as 
drl v4 ng or regdl ng. 

3. Total or nearly total loss of vision. !*| 

2. Hearing (See Instructions.) 

0. No Significant impairment! . 

1. Has some difficulty understanding conversation or using a telephone. 

2. Can handle face-to-face conversation with the help of llpreading', but 
Is unable- to use a tel-ephone.. Is unable to pick up certatn environ- 
mentally relevant sounds (e.g., -bells or high-pitched tones). 

3. ^Extremely hard-of-hearing or deaf; or Is unable to comprehend any speech. 

r 

• ^_ * 

3/ Ambulation or Mobi I ity (See Instructions.') 

0. ^ No significant impairment. 

1. Mild impairment, but does rfbt requi re assistance from Others to 
around in the*communfty. v _ . ' 

2. Moderate Impairment. "Sometimes requires help from others In order to 
get around In the community. 

3., Severe Impairment. Usually requfl^es assistance from others In order to 
get around In the community. * , 

18. judgment 

'* 0. No slgnlf i cant impairment. 

1. Sometimes* makes unsound decisions. Does not** take time to consider 
alternatives or consequences of behavior. • * 

2. Frequently makes ra§h or unwTse decisions..^ Often displays inappropriate 
behavior or choices. 

3. Could be dangerous to s>K or others as a result of foolish or impulsive 
behavior, j _ ^/ ^ \* y 

21. ^Accurate Perception of Capabi litres and Limitations ^ . 1( 

0. No significant Impairment. * - ♦ * 

1. f Behavior with respect to rehabilitation goa4s appears inconsistent (i.e., 
it (Varies from day to day or from one area to another). - P 
Has an unrealistic understanding of h\i or her voc&tlonal capacities (e.g., . 

•'may rule out all vocational poss I b I J ities or, deny, Important *l imitations) . 
3^ Refuses to accept or slgnlf icai}t ly 'distorts his or her limitations* 
Frequently gives other? false, misleading, or &*tpemely inappropriate 
• informctflon about, the disability. ' * 



22. Effective Interaction with People. * / * 

0* No significant impairment". " * 
* t J. Is somewhat awkward or unpleasant In social interactions. 

2. Lacks many of the ski Us necessary for effective social interaction. 

3. Overtly aggressive, Ithdrawn,vdefen$I ve, bizarre, or inappropriate behavior 
often impairs personal Interactions. . 1 
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26. ^ Work Habits XK \ * v - j ' " 

' 0. No significant Impairment. - ' . *y 

P. Is deficient In work h^ts (e.^., punctuality, proper appearance-, 
o» appropriate Interview behavior)./ However, J s willing and" able 
to learn these skills quite ,£eadl ly* » 
• 2. Work habit deficiencies may require that work adjustment training 
p/*ecede ~emp I oyment . ' ' • 

3. Hps severe deficiencies In work Habits and seems to have --'little 
potentlaTfor Improving through work adjustment training. 

Strength Items (Check all- that eppiy.) 

31. Has an unusually attractive physical appearance. 

32. Has an* exceptional ly pleasing personality. 

33. * Is extremely bright, or has ^n exceptional verbal fluency. 



4 




£s*r Reproduced, by permission. Copyright © f980 by tha_Unlverslty of Mi nnesota. 
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•MDC" BEHAVIOR IDENTIFICATION F6RMAT (FORM) 



Oevelop.er^s) . The Form was developed at the Materia Is 'Development Center 
(MDC) of the Department of Rehabilitation and Manpower 

* " • .Services at the Un I varsity' of Wisconsin - Stout and published 

In 1974; • . ' / , 

Purpose The ftrrm was develop^ to^aflLln observing,* Identifying, and 

record} ng work and wor^-rjetaT^d behaviors which Increase or 
decrease employment opportunist I es, - ^ 

Description s * The Form Js oriented toward the evaluation of 22 work-related * 

behavi<frs. Additional behaviors can be specified for evalua- 
— ^ ^ 14om — Soma-ofHtie^ wo rj K behavfofV r^ted I nci u de^ ap pr up r la teness 

* ^ of behavior; cpmmunlcatidn ski Ms related to work; attendance; 
a punctuality; stamina x>r ejghf-hour work capacity; hygiene, 

* * grooming, and dress; and social skills rel^tlng^+o co-workers, 

etc. , ^1 y - ^ , \ 

% The- rating system consists of a series of judgment^ which are 
made regarding time clieijt f s employment behaviorw Whi I e^the 
""ratings are not int^Qded^to yield a totaj score or 
scores, the ratings doVeflect the rater 1 s Judgrgejjt oip the 
. % appropriateness of the>particular client's w/^fkbet^|J^^ in 

relationship to his or her Job goals. , 

Use . The Form seems appropriate for al,J c I ients /experiencing vpca- 

fTsnal handicaps, especially those Involvedi in or being 
considered for participation tn work adJus1yeirt-^Frd/or treatment^ 
programs. It Is also applicable in the sheltered workshop 
„ setting; ' * 




*T ^ The Form is beneficial to^vartous rehabilitation practitioners. 

It pan be' used by case^managers when making ;de<?is ions about 
training that i's appropriate to the c I lent 1 s , needs and goals 
arfcf/or in'making decisions about placement. m Siftce the For 
assessesfcl lent change, it may provide case marfagers and 
* * " % program* managers an Indication of the impact of particular 

\ m -> programs or services. It Is'useful to sheltered workshop 

supervisors and work adjustment personnel In providing* « 
specificity and .structure' in work adjustment training and in . 
assessing client change. The Form's f letflbl I Ity •! s increased * 
in that additional behavior items can be devejopeti and 
* * assessed as- needed. * , 

* ♦ • ' 

Administration Completion of tjie Form requires observation ©f the client and 
y - _ ^ professional judgment. Staff using' the instrument must learrf 
. * * to observe, repord, ancf* report specific objedfffve^ behavior 

. . % * % accurately and use <cons!*stent terminology. Thejnstrujnent can. 

/ % m 'be administered as needed (e.g.'V within days after, a client ■ ■ 

* 1 \ 0 : *begfns ( a Work adjustment myogram, midway .through the program, 

; - 1 - r ^nd again' at the end of tbe program)/ The measure may be - 

• # 1 • " ' j ' " used^Vej^.a period of time in order to obtain an assessment of 

■ ^ ^ 'i & : cl ient/ , , * ' ^ * m - \ 



* r . . # • - * 

Scoring Three majoc classifications are used to rate the client f s 

work-related behavior: "A 11 *- acceptable, "B" - selective 
| placement necessary* *aftd * fl C n -Change needed. Each of theses 
• \ . classifications can be subdlvlcl&d Into two ratings which are 
fl " more precise: A, O) strength or (2) 1 no problem; B, (I) 

.problem - placement or (2) change to upgrade, placement; 
C, (I) change* possible or (2) change doubtful. Definitions 
for each of these classifications are provided. 

\, Ratings can be made.of the client at different times using 
+he major, classifications (i.e., "A", "B", "C" or the more 
precise ratiffgs, i.e., A-l, A-2, B-I, etc.). Changes In 
repeated ratWfCjs suggest* changed Lfl the client's behavior 
and provide the rationale for decisions regarding changes In . 
; service delivery, placement, etc. ^ihe instrument }9 hand 

scorable. 



Reliability 
-Validity 
Advantages 



The reliability of the Form has not been determined. 

The Fdrm has not been validated. 

A majpr- advantage of the' instrument is Its'ab'l I it/ to identify 
^rspecific work behavior probiems and consequently permit the , 
planning of individualized objectives for work adjustment 
services. 



Limitations 



References 



Aval labi lity 



-No evidence for the Form's reliability or validity has been 
gathered. « 

Materia Is^veTd^inent Genter, University af Wisconsin - Stout, 
x RecQmmend^cj/ procedure^: MDC behavior I dent If Icatidh format 



(manual ) . Menomonie, Wisconsin: Author, 1974. 



CoplV 
from - 



s of the MDC Behevior* identification Form can be obtained 



Materials Development Center 
Stout Vocational Rehabl I ftation Institute 
University of Wisconsin - Stout 
Menomonie, Wisconsin 54751 



MDC. BEHAV J OR ' I DENT I F ICAtI ON FORM 



Client's Name 
Client*s Job Goals 



'IT C 

«R?ter 



Period Covered 



Date of 1st Rating 



to 



,2nd Rating 



3rd Rating 



Rating Key 



r A - Accept^t/Te^ 
A- 1 Strength 
A-2 No Problems 
B - Selective Placement 
, B-l Problem-Placement 
B-2 Change' to Upgrade 
C Change Needed 
C-l Change Possible 
C-2 Change Doubtful 



Category 



Beftav^or 



Rat i ng 



I. Hygidne, Grooming and Dres's 



2. Irritating Habtts 




3. Odd or Inappropriate 
Behaviors 



4. Communication Skills 

as Related to Work Needs 



5. ^tendance 



6. Punct6allty t 



7. Ability to Cope With Work 
Problems (Frustration 
Tolerance) 



8." '-Personal Complaints 



9.^ ^Vitality of Work Energy 



10. Stamina or 8-Hour Work 
f ■ q Cajjiactty 

■ERIC ; ■ :. > ' 
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II, „ Steadiness or 

Consistency of Work 



12. DTstractabNtty 



13. Conformity to Shop 

Rules ,and Safety 
*. Practices' 4 - 



"A 



14. Reactions to Change 
In Work Assignment 



f 



Reactions to 
Unpleasant or 
Monotonous Tasks 




16. Social Skills in 
Relatlons^wfth 1 
Co-workers 



17. Amount of Supervision 
Required After Initial 
* Instruction Period 



181 - Recognition - Accept- 
ance of Supervisor^ 
* Authority 



S 



19. Amount of Tension 
.Aroused by Close , S 
Supervision . 



20. Requests for Assis- 
tance from Supervisor 



2L" Reactions to Criticism 
* and Pressure from *■ 
Supervisors 



22. 



Work MethQdraijcf * 
Organisation of 
Tools and Materials 



COMMENTS: 
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MINNESOTA SAf IS FACTOR I NESS SCALES (MSS) 

The MSS were .developed by Dennis L. Gibson, ^ David J, Weiss, 
Rene V. Dawis, and Lloyd H. Lofquist at the' University of 
Minnesota and copyrighted in 1970. They were copyrighted 
In 1977 by Vocational Psychology Research at the* University 
* of Minnesota, i ^ 7 

The MS> are designed to measure the satfsfSctorifiess of an 
' individual as art employee, 

/The MSS consists o^ 28_jtems comprising a total of five scales: 
performance^ conformance* dependability, persona I 'adjus-tinent, 
anti general satisjfactorinesS. Ratings are made in comparison 
to co-worker^ (I.e., better than, about the same as, or not as 
gOfod as h'is or her fellow employees). 

The MSS are appropriate for use with clients who are working. 
Fol low-up - i nformation gathered from the MSS can be used by 
"both counselors and prog rain managers i n* the p lannlng and 
monitoring of their efforts". * Input can be obtained that could 
influence a number of areas of intervention. First, feedback 
on oounseWng outcontes--ean i>3 used to improve counseling 
efforts that have been ineffective in the past. Second, know- 
ledge of th6 receptivity of different businesses to different 
types of clients* can alter job placement practices. Thlni, 
the effectiveness of specific training programs can be studied. 
Knowing which type of client obtains the' greatest level or 
satisTactorinessf In which area can affect both a counselor's 
and a program'^p lanning efforts for clients. j 

The MSS can also be used as^a counseling tool by counselors. 1 
A client sees what work behaviors are important to satisfactory 
employment. The client is able to gain a more realistic view* 
of himself/herself as comparisons of client and' employer per- 
ceptions of satlsf actoriness are examined and discussed. 

The MSS. are designed to be completed by the worker's immediate 
supervisor but can be completed by a fellow empjoyee.or the 
employee ^Iirfse If /herself . The rater should be familFar with 
the worker and the other workers' with whom the cornparison is 
being made. 1/ there are no others in the jol* .category with . 
whom to compare, the pater .shou Ud use those who have done the 
job in the past as reference points. It takes about flve° min- 
utes to rate someone, and It can be administered by ma'I \\ 

item Is weighted according to response. A table listing 
appropriate weights for each Item Is provided* Raw scores 
for each scale are theYi calculated by summing the weighted 
scores for each Item constituting the scale. A hand-scoring 
form Is provided to facilitate this process. 

• • » / . . ■ • * . • 
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Raw scores fop each scale canSbe converted fo, percent 1 1 es 
based on an appropriate norm group. Six norm tables are 
aval lable; ) profess Ionaf,:techn I ca'l , and managerla I • 
(2) clerical and* sales (male)- (3) clerical and sales (fe- 
male); (4) service* (5) machine trades and bench work; and 
(6). workers-! n-genera1 • Separate norms were developed for 
males and females In the clerical and sales area because" of 
slgnlf fcant differences found In the MSS^ scores for these 
groups In this area* m The worRers-I n-genera I group shouid 
be tf^ed for occupational groups ndt represented by any of 
the other norm groups. ■ In general, percentile scores 'of 
75 or*higher reflect highly satisfactory ratings on a scale, 
scores of 25 or below reflect poor satisfactory ratings, and 
those In the middle reflect average ^ t I s f ac t or I ness. 



Confidence bands based on the standardL^rror or measuremertt 
can be determine* for each scale score. Since the scale 
scores artf based on a N s Ingle rating, confidence bandsjielp 
Insure ah accurate J nterpretat ion of the scores. 

Computer scoring can be arranged through Vocational Psychology 
Research (see address In the Availability section). Print- 
outs of group resu-lts and individual scores can be obtained 
as well as Individual punched data cards. Additional data 
analyses can also be arranged. 



The Internal consistency of the MSS was determined by calcu- 
lating Hoyt reliabinty coefficients for the norm groups. 4 
Coefficients ranged from .69 to >95,, with a median of .87. 
These values were generally high and reflected homogeneity 
of content within each scale. 

Test-retest correlations were calculated for 3 two-year Inter- 
val on four occupational groups: ( I { assemblers, janitors, 
maintenance workers, machinists;**^) clerks (male); (3) engi- 
neers; and (4) salespeople. Those who were still In the 
same job two years after the first rating were Included. It 
Is not known h<5w many 6f the supervisors making 'the ratings . 
y*ere the same. Correlations ranged from '.40 to .68, with a 
median of* .50. 

Anderson, ( I96&L looked at the relationship of the MSS to job 
y tenu'rel Among\S group of satisfied workers, as Identified 
by the short-fohn Minnesota Satisfaction Questionnaire, those 
rated abovp the median on the- performance scale of the MSS 
were mor^fllkely toVemaln on the job over a two-year period 
than those ^be low * the median, based on ,chi-square tests signi- 
ficant at the .10 probability level. ^ < 

Group differences on the MSS were studied by* looking at mean * 
scores on each of the'flve scales for employees In sevep 
occupational" groups: (I) assemblers, (2 & 3) clerks (males 
arid female), (4) engineers, (5) Janitors and maintenance 
workers, (6) rrfachlnlsts, , and (7) salespeople. One-way 



analysis of Parlance indicated significant differences at 
well beyond the »0t probability levej'for all fltfescales. 
A significant sex difference oecurred*for cierk^*,* T+r£*only 
area where there were slgnjf leant numbers, of both sexes. 
t Males rated higher on all Scales. Th^ developers feel tKat 
this may due to -rating biases* 

The developers feel that differences among these groups do 
not mean that workers In some occupations are more satis-, 
factory than others* Supervisors may ratfe higher in some 
occupations than others do. It does point out the Import-' 
ance of using the Appropriate norm table for-an individual', 
especial ly when he/she Is changing jobs from one occupational 
group to another. 

The MSS only takes five minutes to complete. Consequently, 
administration by ma(l Is feasible. 



The norm tables presented' represent broad categories or' 
occupations. Care must be given in studying the character- 
istics of th^se workers on. whom the norma were established 
In order to determine if the norms adequately represent the' 
occupational groups, tb which a given client belongs. Also, 
the measure was developed*fn the context of the Theory of 
Work Adjustment (Dawls, Lofqujst, & Weiss, 1968) and is 
most useful In that context. 

Anderson , L. Longitudinal changes in level of work and ad- 
justment . Unpublished doctoral dissertation, University of 
Minnesota, 1969.- 

Dawis, R. V», Lofquist, L H., & Weiss, D. J. A theory of 
work adjustment <a- revision). Minnesota Studies In Vocational 
Rehabilitation: XXIII, 1968. 

Gibson, D, L, Weiss, D. J., Pawls, R. V., and Lofquist, L. 
H, Manual, for the Minnesota sat I sf actor I ness scales. 
Minnesota Studies In Vocational Rehabilitation: XXV H, J 970. 

The MSS as well as pomputer scoring Services, can be purchased 
from — 

\ Vocational' Psychology Research 
N620 Eflfott Hall 
University of Minnesota 
/ 75 East River Road 
.Minneapolis, MN 55455 
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Please check the best answer for each question 
; [ Be sure to answer all questions 



Compared to others Irrh Is/her work group, -how 
well does the employee ... 

1. Follow company pol icies and practices? . . 

2. Accept the direction of his/her supervisor? 

3. Follow standard work rules and procedures? 

4. Accept the responsibility of his/her job?. 

5. Adapt to changes in procedures or methods? 



Compared to others in hls/hqr work group . . . 

12. How good is the quality of his/her work? . 

13. How good is the -quantity of his/her work?, 

\ 



not 
as 

we I I 



not 
as 

good 



about 

the 

same 



better 



about 

the 

same 



better. 



' . ■ * 48 

r " « * ' * — * f . 
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PRELIMINARY DIAGNOSTIC QUESTIONNAIRE (PDO) ' * , 

' J 

The PDQ was developed by # Joseph B. 'Morlarty at the West 
Virginia Research and Training Center and fcopyrighted In 
1981. 

The PDQ is designed to provide structure to the diagnostic 
process In that it provides a quick assessment of client 
employabiilty (functional limitations and client changg) 
across five factors: physical condition} mental condition; 
emotional condition? attitude and motivation; and*soclal, # 
economic, and personal condition. _ 



The PDQ IS comprised of nine subscales. (I) The'-Work Infor- 
mation subscale has 17 items in a right-or-wrong format and 
It Is designed to assess the cl iertt f s general knowjedge of 
the world i>f work. (2) The Preliminary Estimate of Learning 
(PEL) has 30 Items In a right-or-wrong for^nat and it is used 
to assess general knowledge associated tylth jntel I Ixjence. If 
recent IQ scores are aval lab I they can.be converted to 
stanlne scores and this section omr^ted.* (3) The Psychomotor 
Skills section has nljie items and assesses the level of gross and 
fine motor skills* (4) The Reading Ability and Comprehension 
subscale is an 18-item orally administered instrument in a 
right-or-^rong format. (5) t The Work Importance subscale Js a 
-io-frem four-point Likert scale that assesses the client's 
. attitude 'toward work. (6) The Personal Independence section 
' is a 29- item measure ,of clients 1 self-reported physicaj 

independence. Items are rated on a four-point scale as follows: 
/'0 11 cannot do it,* 11 !" requires assistance from another person, 
"2" uses device, and "3". does it him/herse I f . (7) The Internal ity 
subscale Is a l5-*item four-point Likert scale assessing. the 
degree, of, external ity or internal ity< possessed by the client. 
(8X*The Emotional FuncfionPng subscale Is a 22-item self-report 
Instrument designed to identify general psychological pathology, 
using questions relating to depression, withdrawal, aggression* 
self-rworth," and contact with .real ity. (9) The Demographic Informa 
tlon secfrjon considers six demographic* Items (e.g., a£e, sex, 
marifal status, educational level, dlsabt I ity).JtfhLch ar)e coded* 
and scored providing a rough preliminary estimate of what the 
chances'are for competitive employment of a population similar 
to the specific client. \ 

• 

The PDQ Js* designed for'all clients able to give informed 
^gpnsent. It Is appropriate for use in the state-federal 
"rehabilitation program; sheltered workshops; rehabilitation 4 * 
facilities, ^id other settings involved with the rehabilita- 
tion of the handlcappe*d. - 

the PDQ may be useful^ to counselors In the following ways:' y 
(i) PDQ Is a functional assessment tool and may be useful In 
measuring the exteryf of handicap (I.e., how the disability limits 
+hfe individual's functioning). (2) Using PDQ, counselors will 
be able to foVmulate more pointed evaluation questions, which 
- should result In more precise, cpncrete^ usefut^yaluations. 



*C3) PDO Is useful In setting goals $nd planning services. Thus? 
It Is useful In preparing Individualized Written Rehabilitation 
Plans (IWRP). (4) Repeated measures of the PDO provide some 
indication of the impact of rehabilitation services, and document 
client gains beyond vocational status. (5) Results of repeated 
measures can*be shared with cl tents "to. underscore the progress 
already made and to encourage them to continue. (6) Evaluating 
the Impact of services can help the -counselor evaluate the 
relative supe^lorTFy^of different providers of the same service. 




Program managers^sbou Id find It useful In documenting, program J 
movement toward compliance with Congressional Intent (i.e., severe 
disabl e ^ us^b^erve^fff^^^l^— enafrflng-V R to gather pgrHrrerrh 



Information about characteristics of the population It serves; 
providing an indication of the organization^ effectiveness and 
efficiency In that It docurrfcents counselor 1 s 'attention and time 
devoted to various clients on the basis of functional disability 
with respect to cost per case, cost benefit return, and production 
of closure. 

* «• 
The PDQ Is designed to be used In a structured interview and 
relies heavily on self-report. It can be administered at 
different times throughout the program. Use is limited to 
professional rehabilitation counselors who have beeji trained to 
use tt. Training for the admjnlstration and Interpretation 
of thdPpQ Is faclW4^ied by the use of seven modules developed 
by thQ West Virginia-Rehabilitation Research an<i Training 
Center. The PDO "can be administered In less than an hour. 

Tptal raw scores are calculated for- each of the eight subscalgs 
(Demographic Information not Included') of the PDO. This is 
jaccompl Ished by summing the ratings of each subsca'le, WThen 
using the Preliminary Estimate of Functioning (PEH Pro^jle, sub- 
scale scores 4 are recorded. The PEF Is a st-ag-le profile which 
groups each area (e.g., Work Information, PEL, 'etc.) such that 
all possible scores are grouped along nine levels. Level 5 is 
the average levehof performance fn each area, while levels 
1-4 Indicate be low .average performance and levels 6-9 represent 
above average functioning. The profile provides a visual 
display* of the cllent f s functioning over several areas. This 
procedure can be done by hand calculations. 

Three distinct validation sampl-es were used In the development of 
tfce PDO. The College Sample (N = 58) consisted of West Virginia 
"University students selected ff> pfovlderan assessment of the 
soundness of tlje analytic framework" Support! ng \pDO . "The 
West Virginia Sample (N = 151) consisted of clients from the 
West Virginia Rehab 1 1 iTatlon Center at Institute, West Virginia. 
This renter serves multiply-handicapped cMents and its caseload* 
topically carries a Jifgher percentage of mentatfy retarded 
than would the average field- caseload. The National Sample 
<JN - 292) consisted of clients Who were administered the PDQ 
by vocational rehabilitation professionals participating In 
the PD£ Level I training* ^ ^ 

Q 



Reliability da *3 were gathered at thVsubsc/He level. High- 
lights are summarized below. 

The temporal stability of ^ive of the subscales (i.e., Work 
Information/ PEL, Reading Retention, Internal jty, and Emotfonal 
Functioning) was assessed *by reteSflng a* group of clients In 
the West Virginia sample 30 days after the first administration 
(Ni ranged from 26 to 28). Stability correlation coefficients, 
for* these subscales ranged from ,66 to .97. - /' 

The Internal consistency, of each subsca I (except Personal- 
Independence) was 'determined by calculating ltem-toH-otal c 
correlatlons'on the* national* sample. Across the seven sub- * 
scales, the. highest correlation of an Item to Its sCibscale 
score was .69, with .26 as the lowest. Additional Internal 
consistency data Include the following; Internal consistency 
coefficients (KR-20) calculated on the West Virginia' sample 
for Work Information,- PEL, Reading Retention, and Internal ty* 
ranged from .72 to .97. The average item-to-total correlation 
on^the West Virginia sample for Emotional Functioning was .54, 
Work Importance yielded a coefficient alpha of .85 on the 
pol lege sample. - 

Evidence for the validrty of the PDQ was gathered at the sub- 
scale level, using the validation samples described in the. 
Reliability section alove. Highlights are summarized below. 

Construct validity was exanrTft^d on the Work" Iniormation and 
PEL sections by comparing the results wi th -those 5 of the 
Weohsler Adult Intelligence Scale (WAIS) Information subtest. 
It was reasoned that Work Information should be; influenced by 
thk ability of the Individual to Interact jntel I igent ly ; wlth 
his/her^ enVlroninent (as measured by the, WAIS - Information 
subtest) as well as* ? 0y exposure to the world of work, and that 
the PEL acted In a similar fashion ^as the WAI S Information 
subtest, a brief general knowledge scale fughjy correlated - 
with the WAIS full scal,e 10. £ correlation of .65jvas found 
befweren Work* Imformat ton and WATS ^Information (]£*= 43). The 
college sample' yielded a correlation of .t7l between the PEL c 
section and WAIS Information* Further correlations between 
the PEL section anjl existing evidence of Iptell Igence^Were 
calcyl^ted from thfe West- VI rglnfa s samp le: the PEL correlated 
.79 with WAIS Information (N = 43), .71 with the WAIS * * 
full scale 10 {H = IQ^, .74 with the Peabody General 
Information (N^^G)*, and .78 with the Peabody 4 Reading' 
Comprehension (f£ = 15). y * 

Construct and discriminant* val Idlty were examined by looking \ 
at how different groups' performed on the subscales:* 

The Psychomotor ^nd Reading Retention sections were compared 
for ttfe performance of the mentally retarded and non-mental ly 
retarded. The ANOVA technlque t appi led to a national sample > 
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confirmed tha Jj^potheses that the mentally retarded woyld ji 
perform lower on both subscales than ott^r clients** The F- 
value, obtained for both subscales, was statistical ly significant 
at the ,0001 level,, S^rrTi lar results were found on a comparison 
of orthopedical ly/ and non-orthopedical ly-impai red, cl ients on 
the Personal Independence section with F-va lues, sign i ficant 
at the .0005 level. * , * 

Comparisons of the mental ly i I I with the non-mental ly 111 on 
the Emotional Fi^pctioning section were significant at the 
•0001 level. Also, it was found that there is almost a full 
standard! deviation separating the means on thjs subscale for< 
,the men ta \ p/ ill and .th e orthopedlca I l y lmpajredr ,Th^ le n( js 
additional support ta the validity of this ,subsca je. - 

Comparisons on the Internal ity subscale ind-lcated that the 
college sample scored slgnlf Pcahtly higher fhan the West 
Virginia sample (t =*9.0?, £<.00l). Results for the- 
nfational sample fell between the college and We>t Virginia 
groups. ^ 

At this writing* replication of these studies^ is underway 
with a national sample of 1 000 cJ.Jents. This replication ' 
includes a longitudinal study comparing PDQ results a^ intake 
with the exit status of the client. 

Some advantages include the following: PDO provides a quick, 
graphic 0 way of* looking at multiple areas of functioning 
critical to employabi 1 ity in combination £t the same time; > 
. It is relatively easy to U9e; no special tools," equipment or 
. materials are used; and It can* be completed by individuals 
haviog ^he skPIls usually possessed by rehabi I H-ation 
counselors. ' , " 

The PDO assumes^that the client has a minimal level of 
communication skills. 



Mori arty, J. Preliminary diagnostic questionnaire , Duijbar, 
West Virginia: West Virginia Research and Training Center, I98I 

Additional Information can be obtained from — 

PDO Coordinator l ~ 
* West Virginia Rehabilitation 

Research and Training Center ' . . 
One Dunbar Plaza, Suite E . 
' )un£ar, WV 25064 t • . . 

The PDQ Is availableNor purqtiase only f after training, and 
certification. ♦ ^ \ j ' 
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THE SAN FRANC I SCO VOCATIONAL COMPETENCY SGALE , _ 

/ ■ # 

• J ' X 

Developer(s) The scate was devefopedjfy Samuel Levine and. Freeman F. ✓ ^ 
. * ' Elzey at San Francisco State College in 1968. """" 

Purpose The scale was* developed to assess the vocational competerrce 

N of*menta!ly retarded adults. 

• , - V 

Description The scale contains 30 items v/hf.ch are behavioral ly anchored. 

Each Item provi'des either four^qr five statements which repre- 
sent varying degrees of competence for a particular task-. The 



motor skills/ cognition, responsibility, and social -emotional 
behavior* - • - 

Use . The sqale is desTgned for use with mentally retarded adults, 

4 especially in the sheltered workshop and rehabilitation 

facility. Both case managers and program managers will * % 
find this measure useful in selecting clients for training 
and/or placement, assessing changes in the, ciient f s voca- 
tional competence, conducting follow-up studies olj-tho^e. 
individuals who have left the workshop or faciJity and have 
% been placed Un jobs in the community, and study in'g the 
relative efficiency of different trai ning* methods. 

Administration . The scale is'generally administered by the. workshop super- 
visor who is most familiar with the client's performance. 
Observation and - some judgment is required of the supervisor. 
The seals* can be administered at different times throughout 
the workshop experience and takes approximately 10-15 minutes 



to comp lete. 



Scoring The descriptive statements within each item are^ ordered by 

\^ ability level anrf^re numbered fronKone to four or five, 

with option one representing the* lowest degree, of vocational 
competence. The levels are cumulative in that an individual, 
rated five on an item is presumed to be able to perform at 
aH preceding levels. The vocational competency score is } 
J v ° the sum of all of the level numbers selected. The scale 

can ^be hand scored in only a few minutes. 

Percentile norms are available and based on data gathered 
from' 562 mentally retarded persons (344 males and 218 females) 
In 45 workshops representing all geographic areas in the 
United States. Norms were established separately for males • 
f and females, as significant differences irt scores were found 

for males and ^females. 

^Reliability Two tyffcs of r&U&bi I ity data are available - internal con- 
sistency* and test-retest. The internal consistency measures 
are split-half correlation coefficients corrected by the 
Spearman-Brown formula. Calculations were made separately 
for 344 males and' 218* females'" I n workshops; each yielded a 
rel lability coefficient of .95. 
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A stability coefficient was derived frofn retest ratings for 
54 individuals obtained approximately one* month cTfter the 
initial rating. The stability coefficient was .85, indi- 
cating satisfactory "reliability scores over a one month 
-interval. (This coefficient was computed for the total group, 
rather than separately by sex, because of the small number of 
cases. ) / - 

* * * 

Coefficients of correlation were computed between vocational* 
competency scbre^ and chronological age, mental age, 1Q, . 
school experience, and workshop experience for samples of 
344 males and 2 1 8 females in workshops. The correlations 
with I Q were .48 and . 38~(]T< .1) I ) , and the correlations 
with school experience wefe .15 and .20 (£<.0O» The 
other correlation coefficients were not statistically significant 

The f6 1 lotting advantages are reported: O) The scale is * 
comprehensive .with respect to elements^of^work situations, 
making it useful, in a wide variety of, contexts, (2) "Since 
the (performance to be observed is stated in behavioral terms, 
inference in the evaluation process is minimized and ^rel iabH ity 
is increased. (3) The technical considerations in the evalua- 
tion process are* reduced, in that no special test situation - . 
need be established nor is it necessary for?^ psychologist 
to administer the scale. (4^ This is one of the few standard- 
ized scales o'f its. kind for mentally retarcjpd -ql tents, 

* i 

• . ♦ o 

The items do not haue equal weight since sf/me items are scaled 
oh a 1-4 continuum^and others ofi a 1-5 con&hnuum. /\lso, the - i 
only score obtained is a total score which does provide* a 
global assessment of the individuals competence but does 
not indicate Specific strengths and weaknesses. The test 
manual stated that four dimensjons of vocational competency 
are being measured. Hence, it might have been helpful to 
> include four separate scales, one for each dimensiQn, to' 
assist the training program or workshop instructor 1n identifying 
the specific areas which require remediation. ' 

Levine, S., & Elzey, F. F. San Francisco vocational compe- 
tency scate manual . New York: 'The Psychological Corporation, ■ 
1 968. ^ - 

The San Francisco Vocational Competency Soale and its manual 
can be obtalned^ffom ~ — * \ ^ 

f The Psycho log i-ca I Corporation; 

757 Third Avenue • » * - 

' New York, NY 1 00 1 T 
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SAMPLE I^M • 

SAN FRANCISCO VOCATIONAL* 
/ COMPETENCY SCALE 



[BERING- -INSTRUCTIONS 



' • After a task has beery exa 





anrf demon- 



strated, needs the ! nstr^tfons repeated before 
he (she) can Reform the3*ask on his Cher) own. 

1 Nearly always 

2 - frequently v 

3 Appro&mately half the 

4 - "Occaslopa My 

5 -Hardly evef* 




V 



v 



i 



Reproduced bv^pfermlssion from the San F^a^cisco Vocational Comfteteqcy Scale. 
< Copyright© I9&3 by The Psychological Corpp'ratlon, New York, New York." 
All rights resOTVed. 4 » % 
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^ A SCALE OF EMPLOYABI LITY FOR* HANDICAPPED PERSONS (SE) 



Developer(s) 



Purpose 



Description. 



Us$ 



SE^as developed and refined from 1957-1963 at the Chicago 
Jewish Vocational" Service (pty/S)/ 

The general purpose of SE_ is the evaluation of- the employ- 
ability (i.e., the ability to* get and -keep a job) of vpca- 
tionally handicapped -persons^ ' * 

v S 

SE^ consists of three separate behaviora I ly-anchored scafes, 
i.e., Counsel ing- Scale (39 items), Psychfcfpgy Scale (27 items) 
and Workshop Scale (48 items), which are designed to measure* 
significant Components of work behavior among handicapped indi 



Each scale contains 
independently. 



viduals. Each scale contains a number of subscales which can 
be scored 

The Counsel incfScale assesses lartguage skills, dependency 
of client, effect of handicap^upon client, marketability" 
of client as Related to his/her handicap, employment 
^record or*history, attitude and mofivation, appearance " 
and general impression, and mtfrketabi 1 ity of client as'Ve- - * 
lated to placement; The Psychology Scale assesses functional 
level of'abMity, relationship to authority figures a^work, 
relationship to peers, and effect of client's principle 
handicap upon emp lOy^W I ity. The Workshop Scale assesses 
ability to mobilize and direct energy in thp work situa- 
tion, capacity to tolerate and cope with pressures, tensions, 
and demands of 'the job,/ interpersonal relations wfth co- 
workers and foreman, and functional level of ability in the 
work situation. * • , 4 



SE is appropriate for 
cappe'd as a result of 
social di'sabi I itite^. 
service programs, 



cl ients 



vocat lona I ly handi- 
, menta I , and/or' 



who are 
emotional, physical 
It ¥$ applicable in most j~ehabi I itation 
especially vocational adjustment workshops. 

The SE^ is useful to case managers, program managers, ^n^l rer* ^ 
searchers»in a variety of social sea/ice, welfare, vQCp£Honal 
guidance, and rehabilitation agencies. The^ instrumerft is 
designed to be used in y th^ following situations: deter- 
mining the feasibility of 4 rehabi I itation, integrating 
di^gnpstic data, seleicting.vocational goajs, evaluatipg 
services, needed 3 by the cl ient/ measuring vocational improve- 
ment,' maki ng^omparati ve evaluations of alternatiye tech- 
niques^ of rehabilitation, and providing an evaluation of 
caseloads. • 



Administration 

5 1 

* 

/ 



.Thfe administration of the SE^ requires professional judgment. 

. The Workshop Scale is to.be administered by the rehabi I ita- * 

'flon workshop foreman; the Counseling Scale by the* vocationa I 
counse (drT^artd/hhe Psychology Scale by the psychologist after 
administering a battery of standardized tests*. The scales 

-xanr be administered whenever needed. For example, Counseling 



and Psychology Scales have been administered before the client 
enters the workshop, and the Workshop Scale 'has been adminis- 
tered^after a two or three week diagnostic period, midway 
through the workshop program, arfd at its Conclusion. The- time 
requrr^d for a workshop supervisor, counselor,* or psychologist 
to complete a scaJe for^a client should be from 10-20 mfnOtes. 



The scoring procedure for each of the. three scales is the same. 
Total' scale and iubscale scores can be determined for each; 
however, it is not intended that the three total scale scpres be 
combined into one SIE score. 

^ ach * tem is scored on a four-point* scale, vthere a score of 
"I'^npans the client is clearly adequate, and "4" means the 
client is clearjy inadequate for the particOlar trait or 
factor being measured. Scores of "2" or "3" mean the client 
is "borderline or better" or "borderline or worse," respect- 
ively. Ratings on tasks; that have not been ^assigned to the 
client are omitted and do not influence the score, the raw 
scores are then weighted and- summed and put into a formula 
to determine the total scale score. A "Table for Converting 
Raw Scores on the- Workshop Scale to Final Scores" is provided 
and makes scoring even simpler. 

i 

The scoring* procedure reflects the level of behavior, at which 
a client is judged to be behaving, not just the adequacy of 
the client's behavior relative to other clients. A client , 
who receives a high* total scale'score on one of the>three 
scales wou'f-d be judged as behaving etf a very appropriate 
level overal I- on that scale, regardless of how well he/she miglrK 
be doing in particular areas of behavior (as 'measured by 'sub- 
scales). A client who receive? a low total scale score, on "the 
pother hand, would be judged as performing on a very inadequate 
levef at the time of the rating. 1 , " 

Reliability data are avai labffe /for the'TVorkshop and Counseling* 
Scales: 

*. » 

Workshop Scale ♦ 
Mnternaf consistency, examined through product moment inter- 
correlations of subsections* to the total score, *was generally 
v high, ranging from .66 (jj<.0l) to .93 (£ < .01). Sub--' 
section correlations^th other subsectlSns wene lower, * 
ranging from .29 (£^05) to .72 <£ < .01 ), indicating less 
homogeneity. ' 

To determine interrater reliability, 50 clients, were rated' at 
the end of. the fourth and fifth weeks of the program- by dif- ' 
ferent foremen. Product moment correlations' ranged from .30 
(j>.<..05) to .63 (j) <.0J). 'Some clients, however, were sub- 
jected a changed situation between ratings^ This change and . 

'not the rater could cause lower 'correlations. Re-analysis, 
separating clients who had experienced significant changes In 

\s£lf or type o¥ supervision between rating^ from those whose 
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situation had remained "stab lei" produced higher interrater 
correlations for those in a "stable" situation (.47, j> < •O' 
to .73, j> <*0 |v and lower correlations for the "changed" fc 
group (. I0 # to .54, j> <.0I ). ' - *x ^ 

A final measure .of the reliability of the* Workshop Scale 'in- 
volved test-latest by, the same* foremen .with a four-week period 
separating! traT^tfngs. Reliability coefficients of .81 
Cj><.OI) and :95 (g <.0I) were yielded by the total scale. 
The individual subsections were more variable in this respect, 
with coefficients rang! ng. widely between k 59 (p < .01) and 
.81 (j) < .01). Thus, it appears that a foreman f s total score 
;can bQ^ellej}^ uoon , whereas section scores are Less dependable 
measures/5femp loyabi I ity. 



Wc ^shop and Counsel inq Scales Together* - v # 
Correlations of each ^subsection of one scale with the total 
vscore of the other did not, yield significant results on a 
small sample.^ However, it appeared promising that eaqh scal$, 
Workshop and Counseling, was independent and contributed ^ 
something unique to *c I lent assessment. ? / 

Evidence of validity is available- for thp Workshop and 
Counseling Scales: 1 u 

\ - v 

Workshop Scale * 
Criteria for estimating * the concurrent validity of the- 
Workshop Scale : nclude emp lo # yabi I Ity ratings*, placement- 
ratings, and sta£f decisions to. continue or terminate the- 
client's stay H the program. The employabi I Ity antKplace- 
ment ratings were made by the entire staff at two different - 
workshops during group conferences held at three predetermined 
'times. The WorHshop Scale was completed by individual fore- 
men at the same three times. All correlations were significant 
at the .05 level, some at the .01 level. ^ * 

The criteria used for estimating the Workshop -Scale's^ validity 
as a predictor of employabi I ity include placement success, 
length of placement period*, duration of first job, and duration 
of alf jobs' (ue., percentage of .time worked on all jobs 
after getting tne first job)/ Follow-ups at. three, six and 
nine months were studied. >The most prorrtfnent finding is the 
variability of the correlations^/ These range roughly between 

* .Q3 (correlation of Workshop Scale scores .with criteria ^ ■ 
from ninewnonlt follow-up) and .62 (correlation of Workshop / 
Scale scores with criteria from six and three-month fol low- 
\ips).' Typically, correlations have values between .20 and 
.40, and* a, v cons! derabje number are significant at the .05 
and .0J* levels of confidence. It Is clear that the Workshop 

' Scala ugually has a moderate degree of power In predicting 
employment outcomes. The data also suggested that p lacenjen* 
success seems to be predicted somewhat more accurately than 

/.permanence, of employment, 1+ Is concluded thqt the validity 
of the scale extends out at least over a £1x-Hnont)i fo! low-up 
.period, and in Instances over a nlne-iyonth period. , 



' CounsgHriq Scale / * 

The correlation between total score and job placement was 
found to be ,28 .05). Though sample size was small, 

the scale did show promise as a prediction tool (but not 
for the minimal ly handicapped). The need for the refinement m 
of some of the subscales was*evident. 

* Workstop and Counseling Scales Together . 
The scales were combined through multiple regression. The 
correlation between the combined scores and getting a job 
was' found to be .51. Though sampfe size was small, the com- 

j bined forrii did show promise as a predictor. 

The ""major advantages are (l) the scales reflect behavior 
directly and can therefqre be used by service personnel with 
varying degrees'Of experience; (2) the subscales for each 
scale, or alternatively the factors uncovered for the Final 
Report, provide profiles for^individual strengths and weak- 
nesses; (3) scores on the Workshop and Counseling Scales 
*Were reasonably good predictors of work potential; $rfd (43 
several research applications are possible. — 

First, re I labi I ity scores were not suf f icient ly' high. to 
warrant full confidence, although minor modifications of 
the -S£ in other pVojects conducted by the Jewish Vocational 
Service had much higher rel iabl U/h^~ -The key fay in the 
degree of staff training and conjimjous monitoring. Second, 
it took longer to use than some pther instruments with 
similar purposes. Third, the Psychology Scale was oof x 
v^fruitful in the applications tested. ' ^ 
» 

Bolton, B. Rehabilitation counseling 'research . Baltimore: 
- UnyyersNity Park Press, 1979* 

Chicago Jewish Vocational Service. A scale of employabi ) i ty 
. for handicapped persons, Finaf Report . Chicago: Author, 1963. 

Chicago Jewish Vocational" Service. ' A sea le of employabi I i ty . 
for handicapped persons. Third Progress , Report . Menomonie^, 
Wisconsin: Marorlals Development Center, University of 1 
Wisconsin- - Stout, 1959, 

A scale of Employabi I ity for Handicapped Persons, Third Progress 
Report, including the scale items .and other pertinent informa-? 
tlon, is aval Iabl e^rQm 



Materials Development Center V> 
Stout Vocational Rehabilitation Institute 
-^University of Wisconsin - Stout 
Menomonle, Wl 54751 
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. An annotated bibliography on*the scale and -reseafcft project's 
using the scale can' be obtained from — 



Asher Soloff 

Chicago Jewish Vocational Service 
rSouth Franklin Street \^ 
Chicago, LL 60606 
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SCALE OF EMPLOYABI LITY FOR 
HANDICAPPED PERSON'S • 

WORKSHOP SCALE 

20(RK Effect of his onn foreman y s correction on performance; kind of 
change produced 

1. Performance always or almost always improves • 

2. * Performance sometimes remain^ the same: sometimes Improves 

3. Performance generally remainsthe same 

4. Performance genera gets worse. 

2I(R). Reaction to supervisory pressure for Increased production 

1. Increases output under pressure andisustains increase v 

2. Increases output, but cannot sustain increase 

3. Noxhange in output r 
^4. Ou'fput decreases. 

22(B). Client's participation in group structures 

1. Accepted as a leader: is center of conversation or social 
activities m * 

2. Active participant i/i "social or conversationa I activities 

3. Passive participant:^ essentially a listener, but remains 
part of the social group 

4. An isolate from social activities. 

COUNSELING SCALE 

7(H^S . Client's tension level revealed during interview 

TENSION LEVEL^OR NERVOUSNESS REVEALED BY CLIENT DURING INTERVIEW IS: 

1 . Appropriate * 
% - 2. Slightly inappropriate 

3. Moderately inappropriate 
• 4. Strongly inappropriate 

8(HC). Client's assimilation of handicap 
* 

THE, DEGREE TO WHICH THE CLIENT HAS [(EARNED TO "LIVE WITH" HIS 
HANDICAP; THAT IS, THE EXTENT TO WHI^H HE HAS MADE A DESIRABLE 
ADJUSTMENT TO IT:. 

' " f. High 

2. Moderate 
v , 3. Slight 

Iffibderate 

.9(HC). Client's attitude toward handfcap as a barrier to his employabJ I fty 

, THE DEGREE TO WHICH THE CLIENT'S ATTITUDE TOWARD HJS HANDICAP WILL BE 
. A- BARRIER TO HIS EMPLOYABI LITY OR PLACEABI LITY' 15: 
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* § 

I. Negl !glb le or none . - - . r 

• 2. Slight • . '* 

* 3. Moderate * * * • " , 

4. Severe * * , _ 

PSYCHOLOGY SCALE - * 

6 - Potential satisfaction or gratifications 

THE POTENTIAL SATISFACTION OR GRATIFJ CAT IONS WHJCH THE CLIENT COULD BE 

2?« E ' N F E W0RK SITU ATION, IN SO? FAR AS HIS CONTINUED 
XIS^S^ ^PLOYM^WOULD BE DETERMINED BY SUCH SATISFACTIONS OR 
GRATIFICATIONS, WOULD BE: 

" • I'' o de f a !? : " n ° P red,c+able Averse effects in maintenance of employment. 

2. Borderline or better": some slightly adverse effects are predictable. 

3. Borderline or worse: some moderately adverse effects are predictable. 

4. Inadequate: some considerably adverse effects are predictable. 

7 - Reaction to pressure s and demands beyond customary level V . - 

fc5<rf U S! T TL P ? E ? ICTED REACTI0N T0 PRESSURES AND -DEMANDS BEYOND THE CUSTOMARY 
i E ! E i; TQ THE EXTENT T0 WHICH APPROPRIATE REACTIONS WOULD BE REQUIRED FOR- THE 
MAINTENANCE OF HIS EMPLOYMENT, WOULD :BE> * ■ 

I. Adequate: no predictable adverse effects in maintenance of employment • 
x ' a J* F !" e ° r . be++er: SOfne si ightly adverse effects are predictable. 
. 5. Borderline or worse: some moderately adverse effects are predictable 
*,4. Inadequate: some considerably adverse effects are predictable. 



^ Reproduced by permission. of the Chicago Jewish Vocational Service. 
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THE SERVICE OUTCOME MgASUREMENT (SOM) FORM 



} 

Developer(s) The SOM Form was developed by Lowell Lenhart, Will Lam 
L tfesterheide, 'and M.' CI inton Mi I ler M I at the 
Oklahoma Department of RehabI f itation and Visual Services. 



Purpose The SQM Form wa^ designed to assess-caSe difficulty and 

client change In rehabilitation clients. 

• a 

Description The SOM Form consists of 45 items (22 routinely col I ected 
demographic items and 23 behavioral ly anchored items). ^A 
revised version contains 16 beb^viorally anchored Items 
rather than 23. The behaviorahly anchored Items, which 
place emphasis on the client's functional abi titles In re- . 
I at ion to employment, require 'counsel or ratings on a 'five- 
point scale. An orthogonal factor analysis of the SQM Form 
requesting five factors yielded the fol lowing factors: 
economic/vocationa I , physica I functioning, psychosocial 
^\ * functioning, family relationships, and education. 

Usp " . ■ * The SOM Form' seems appropr iate = for all cljenfs. Since it is 

quickly and easily administered and scored, It is particularly 
useful In the state-federal rehabilitation system.- It is 
useful to case managers" and program managers^ - It provides the 
case manager an indicator of the client's functioning and- re- 
peated measures may Indicate success of the case manager's 
intervention or needed changes fn services. The SOM Form 
provides program managers a more adequate outcofae measure ot 1 
rehabilitation services (i.e., various potential client gains 
beyond the traditional vocational area); therefore* it permits 
more eftectlv w e program evaluation, development, and management. 

A 

A verV thorough exp lunation of the SOM Form to adnfin fetrators, 
middle managers, and especially coynselors is critical to the 
successful introduction of this measure info a program. Pre- 
initiation training and follow-up reports and discussions are 
vital. 

! 

Administration The SOM Form contains both, objective and subjective data, and 
* * re-l fes on counselor judgment. It has been administered as a 

pretest measure after acceptance for rehabi Uatfon services 
and again as a posttest measure after closure or one year after 
pretest. Familiarity -with the Instrument and knowledge o±"the 
client's present level ofs^^ffrKtionipg is necessary to complete 
; the SOM Form . After j^rerviewing the client and reviewing 

existing records, the measure can be administered In about_ 
five minutes. 
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Factor scores, -area scores, and total scores can be calcu- 
lated. ^ Factor and area 'scores consist of the sum of the 
ratings for the items In that factor or area d! vfded by the 
number of 'Items In the factor or .area. A total score Is 
computed by summing the factor or area scores. Change 
scores for the area, factors, and ,to±al scores can be de- 
rived by subtracting the posttest scores from the pretest 
scores. The SOM Form can be- hand scored in five to ten 
minutes. 

A reliability study of the SOM Form involved counselors from 
three states. Five counselors in each state* rated ten test 
cases using the SOM Form . Product 'moment correlation coef- 
ficients were computed for all possible^ pairs of 15 counselors 
•involved. A pooled estimate of the correlations #as obtained 
by transforming the boef f icients, using Fisher's z, then / 
averaging the z scores, an\j converting back to a pooled esti- 
mate of the correlation.- The reliability estimate for the' 
total scores achieved by the 15 counselors was ,93. The 
reliability coefficient for the five areas ranged from .69 
to ,95. The results indicate a very good interjudge reli- 
ability for the SOM Form . Thus, if. provides a, method of 
^establishing the client's physical, educational, and psycho- 
Vpcial functioning and hence a method of measuring client 
status and client change. 

While the face validity of the SOM Form Is substantial, a 
factor analysis was performed to arrange client attributes 
into the mosT meaningful subgroups for the measurement of r 
change and to explore the possibility of deleting redundant 
scales. The factor analysis was performed on pretest "data 
which included 1945 SOM Forms completed by 389 rehabilitation 
# counselors in a six-state area. Factor analysis yielded the 
five following factors; Factor I econom I c/vocat iona I ; 
Factor 2, physical functioning; Factor 3, psychosocial func- 
ing; Factor 4, f ami relationship; and Factor 5, educa- 
The factors correspond to the-original purpose of the 
•ument which was tcffneasure the status of the client in 
)hysical, psychosocial, and educational areas as ^well as 
id it! ona ) econom I c/vocat iona I area. • * 

A second factor analysis utilized only 16 scales and the 
academic education Item as compared to th$ oViglnal SOM Form 
v 23 scales. Of the original 389 counselors, 364 completed 
ratings of' their clients on Global Case Dlfficufty, Time and- 
Effort, and Severity of Handicap six months after the pre- 
test* Substantial .correlations were found between SOM Form 
^ratings (I.e., area scores, factor scores, arvd total scores) 
and ^counselor ratings, significant beyond the .01 level. 
Little was lost by using the shorter factored version. The 
SOM Form had demonstrated solid internal structure and 4 a sub- 
stantial relationship to counselor ratings of Global Case ^ 
-Difficulty, Time and Effort, and Severity of Handicap. 




Limitations , 



Advantages Some of the' advantages of the SOM Form include the following.-. 

• ! First, case difficulty and client change are viewed rn terms 
of cl ientf unctiqnihg in relationship to employment. Second,, 
the instrument provides for pre- and post-measures. Third 
. It can be administered and scored quickly and easily by the 

rehabilitation counselor. Fourth, It covers a broad area of 
client chaYige beyond the traditional vocational af-ea. F(,fth," 
it Ts practical for agencies- that lack sophisticated data 
processing equipment.' " * ^ v — 

Some limitations inherent in the SOM Form include the fo4 lowing: 
> whl le the rating Is standardized, 'evaluation -sti I I relies on 
counselor judgment regarding the client's situation and degree 
of change; and the system- provides no way of determining +he 
impact of the rehabilitation process upon the observed change, 

c 

References Bassett, P, T> - Measurement of outcome: A report from the 

study group oh measurement of outcome . First Institute on 
Rehabilitation Issues, Denver; Colorado, April 1^-17/ I974. 
Institute, West Virginia: -Research and Training Center, I974. 

• 

Vandergoqt, D. Further evidence-of the factorial validity 
of the service outcome measurement form. Rehabi I Itation 
Counsel inq Bui let in , 1 976, 20, 1 44- 1 47. 

esterheide, W. J., Lenhart, L., & Miller, M. C, Monograph 
I: Field test*of a service outcome measurement form . 
Oklahoma City, Oklahoma: Department of institutions, Social 
and Rehabilitative Services, 1 974. . 
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Vtesterheide, W. J., Lenhart, L,, & Miller, M, C. Monograph 
III? Field testing of a service outcome measurement form . 
Oklahoma City, Oklahoma: Department of Institutions, Social 
and Rehabilitative Services, I975. 

The SOM Form and other pertinent information can be obtained 
from — - 



Program, Evaluation Un*Jf 

Division of Rehabilitative and Visual Services 

Department of Human Services 

P.O. Box 25352 

Oklahoma City, OK 73h25 
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SAMPLE ITEMS ' 



SERVICE OUTCOME MEASUREMENT FORM 



DIFFICULTY ONLY \ 
A* Anticipated Change in Client's Level of Functioning During Services 



1 . A I lev late * 

2. Improve Greatly 

3. Improve Somewhat 

4. Remain the Same 

5. Deteriorate 



r 



B. Employment Prognosis- 



I. 

2. 
3. 
4* 
5. 



Presently employed In competitive labor market and will 

continue on same job or higher Jbb • ^ 

Employable at former job or another job without training 

Vocational training required; client has 'training potential 

Limited vocational training potential 

No vocational training potent! a f 



ill. 



ECONOMIC VOCATIONAL STATUS 
0. Primary Source of Support 



1 . Own Earnings . ^ ' *> 

2. Dividends, Interest, Rent, and Savings 

3. -Family and friends, or non-dlsabi I Ity Insurance (Retirement, 
Survivors, Annuity, etc,) - 

4. Disability a/id Sickness Insurance (SSDI, Workmen's Compen- * 
station, Civil Service, etc.) 

Public Assj stance, Private Relief, or Resldenf;of Public „ 
"^ti tut ion - ' ' 

E. Dependency of Client on Others f6r Financial Support 

; ^_ I • Completely Independent 

^ > 2. Approximately, 25$ of income comes from sources other than earnings 

: 3 * ^Approximately 50£ f ofc income comes from sources other than ^earnings 

4 ' Approximately 15$ of income comes from sources other than 'earn! ngs 

5. Totally dependent on sources other than earnings 



IV. 



PHYSICAL FUNCTIONING ? 

* 

A. "General Health Status Other Than Disability 



I. 

2. 
3. 
4. 
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Feels good most of the time, has feelings of vitality • 
Generally feels good, byt reports minor problems that seem reasonab 
Multiple complaints, cWhlch seem mostly reasonable ; 
Multiple complaints that seem mostly unjustified by physical condlt 
Multiple complaints .that seem totally unjustified by his 
physical .condition 
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V. ADJUSTMENT TO DISABILITY 



A. Identification with Worker Role 



L (Slent feels personal need to be Independent*, and do his share 

2. Identity to worker role developing or deteriorated somewhat 
since disability but wants to' work 

3. Weak Identity to worker role, little Idea of day-to-day work f 
demands 9 

4. Client has adjusted to being dependent; talks of working but 
Is unconvincing ^ 

5. CUent strongly Identifies with handicap, and cll<ngs to dependent 
•ho I e 



B. Compatibility of Employment Expectations wltb Clients Personality and 

Physical Condition • 1 ; * 

♦ , 

I. CI lent 'seems Ideally suited for the work he desires 

2. t Client's employment expectations are reasonable, although 

not Ideal 

*, 3, Client has no Ideas concerning possible vocatfonal goals, 

or his Ideas are more "day dreams" than employment expectations 

4. Client's employment expectations are very unrealistic and 

Impractical 

5. Client's employment expectations are so totally unreallstTc 

and impractical, counselor must work w«ith other professional 
• persons, agencies, or institutions before client can proceed.. 
In the rehabilitation process 



VI'. SOCIAL COMPETENCY 



Language Fact I ity 

I. Reads and writes well; has no trouble understanding ancy ^ 

| communicating common Vernacular and eould learn to use 

technlca I language \ * 

.2. Reads, 'speaks, and wrPtes adequately; has no particular 

problem ffVBng out employment applications, or holding 
job I nterviews j 

-I 3. Reads, speaks, and writes adequately, for job applications 

and Interview, but speaks slowly and may hsve some difficulty 
with other than simple written instructions % 

4. RSads, speaks and/or writes poorly, and will have difficulty, 

interpreting even simpje written instructions 

5. Almost complete lack of language, functionally illiterate, 

extremely small vocabulary 



Reproduced by permission of*the State of Oklahoma Rehabilitative Services. 
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VOCATIONAL ADJUSTMENT RATING SCALE FOR THE RETARDED 
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Purpose 



Description 

v 



Use 



The scale was developed*-™ -1,97 1 by V\gnes Y. Song, then with the 
Cooperative Services Agency* irr Burlington, Wisconsin, and 
Ralph K. £ong, then at Wisconsin State University. 

This scale was designed to assess the work adjustment (I.e., work 
pef-formance and work-related behaviors) of mental fy retarded 
adolescents and adults in all work self 



Admin i strati on 



Scoring 



Reliability 



sejttipgs. 
52 , 1 tems 



This fol Low-up instrument contains 52, items that assess wonk 
adjustment *in five^reas: work ability, work habits, withdrawn , 
behavior, aggressive behavior, and bi zarre' behavior. These 
five subscales, or sections, arre intended t-o correspond to 
the list of important behavioral variables of retardates- identi- 
fied by the American Association onjtental Def icfency, namely 
skills, conformity, and interpersonal relations. -Each of the s 
52 items is a five-pomt scale (i.e., very poor^to excellent or 
very often to never). , . ^\ • • " * 1 

This scale is designed to be used with mentally retarded adoles- 
cents and adults. It seems appropriate in settings where work 
performance needs to be assessed (e.g., sheltered workshops * 
rehabilitation facilities, etc.). 

The scale is useful to both case managers and program managers. 
It provides case managers an indication of the vocational adjust- 
ment of the mentally retarded client. * Therefore, it is helpful 
in making decisions about placement 1 as well as providing p?o- ' 
spective employers more detai leg. information about prospective 
employees. a The scale is beneficjal to program managers in 
identifying what skills persons completing rehabilitation have. ' 
acquired. This is'also attractive. in that sections of the* 
scale can be used as needed.' * 

The rating is conducted by the immediat^work supervisor' of 
the individual being evaluated during or after training or 
employment. The administration of the vent I re scale takes 10-15 
minutes. 

Both subsca I e scores and total scores are calculated. Items 
are rat§g on five-point scales With values ranging from 0-4. 
The scores are simply the cumulative summation of all of the 
item scale values within a subscale or the entire scale. The 
reference point for rating is the average worker in a particular 
work setting. - 

The stability of the scale was asseslH by^he JJearson correla- 
tions between the scores obtained from the first and second 
ratings. The t/me interval between the two ratings was about 
a week. The ttfst-cetest reliability coefficient for sections 
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f If i'UJ'U IV, V-, and the total scale were V90, .93, .78, .91, . 
.75, and .92, respectively^ ^ * • 

Th^omparabi I ify of the halves of 4*hfe scale was indicated^by 
a IVfgh sp»l it-hal f j^liabjlity coefficient of ,97-. The internal # 

* r ^nsistency of -the scale was fui^her studied by looking at the 

intercbrrelatrons among the, sections of the scale and the 
total scale. The -correlations Between secfions I, U, \W,\ 
IV," and V and' the tota V sea le showed .79, 183, .63, .76,'iand 
;88, respectively lt k can be, seen that. theVexceptioruoi* 
sectic?ns III and^nV, the sections show substantially high 

* correlations. These hi£h correlations surest homogeneity and 
give spme evidence of the internal consistency of the scale. ^ 

' V- ' 
Concurrent validity -was examined by looking at the scale results 
against, the criterion of the supervisor's Independent classi- 

* fixation of the Retarded worker as excellent, -good, fair, poor, 
l Or very poor* * Correlations with the criterion^were ass^ssTed 

by deriving the Pearson p's between various secfions oC the* 

* scale and&the criterion classifications*^ excellent, good,^ 
fair, poor, and very poor. All of the r/>6 were substantially 

h ^h_exce£t_ f qr_ section IV, aggress i y_e_ .beww i [or The Pe arson ; 

- £ f s with criterion are as fol lows:^^ctij>n I, work ability, 

.91; Section 4-1, work habits, ,89; sestJ^Sn III, withdrawn 
s ' behavior, .78; section IV, aggress iv^tjehavtor, .59; section V 

bizarre behavior, .88;" ar>d total score, .97. 

The scores of the five criterion groups (i.e., very' poor, ftoor/ 
etc. J were contrasted. Total # scale scone means of the five 

^ criterion groups* were compared by analysis of variance. The 
resulting £ of 198,5 was significant at.£<.00l,. The Duncan , 
multip le R values indicate that the scale as a whole discrimi- 

* nated different adjustmertT^ci>f/s at a statistically significant 
I eve I . 

Predtetive validity was examined using a criterion based on 
45 retardates orginally rated by th^ir prospective work super- 

* visors in the institution and then*placed In community jobs * 
for a minimum of two wefrks. The employers were asked to 
classify these worKer^/as either excellent, good, fair, p<x>r, 
or very poor. The r/s between this criterion and sections 

I, II, JjTlTTX, ar\d the total scale were ,-.22, .44, -.07, 
.07, \IQ, and\l6, respectively. Only section II* work habits, 
showed a moderate predictive power; These findings may have 
resulted from/different criterion situations, as factors - 
^"'associated with vocational adjustment vary/^rom job to job' 
^^p.rogram (Bae, 1968). Standardization of the scale In a 
variety of work settings may improye the predictive power. 



Construct validity was examined by ltx>king at the correlations 
of the scale sections with 10. The^Hs between sections I, 
llv U t; IV,, and. V and the Wechsler Intelligence Scale for 
Children and Wech'sler Adult Intelligence Scale I showed 




correlations at J9, . M, .13, -.05, and ,07. These results 
indicated that the scale was relatiyely f ree from the influences 
of IQ. - ' \ m . 

Advantages. \ : The scale can be used with clients at'any lev 4 el and in different 
work settings* 



i^nts^ 



A clear description of the*client T s work environment (e.g., 
types of tasks *and characteristics of the'cllents) must be 
included whefTresults are -reported to present an accurate 
picture 



Limil-ations 



.References * y*Bae (Song), A. Yo ' Factors influencing vocational efficiency 

' " of li-nsti tut tonal i zed retardates *in different trailing programs. 
AmeVican JournaJ of Mental Deficiency, 1968, 72, 871-874. 

SoneJ, R. H. and Song, A. Y e Development 6f a vocational rating 
4 scales for' the retarded. Journal of Counseling Psychology, 
1971; _[8 (2), 173-176. ■ 

* *K ( \ 

Availability C<JpieS of "the ^ale can be obtained from — . * 

^ Ralph hUSong, Ph.D. , 
0 fc 925, Burningwdbd Way * « r ' 

c * ' " . \ , Madison, WJ 53704 . 
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• SAMPLE ITEMS 

V 

V0QA>10NAL ADJUSTMENT RATING 'SCALE 
\J FOR THE RETARDED 

-GENERAL 'INSTRUCT IONS 



Please read each Ijne on ihe scale carefully-, and place a check .'mgrk(^) on the 
appropriate line under the scale value to which this particular trainee, or worker" 
belongs. PJeaje do not skip any item. The' reference point for your' rating is the 
average performance or behavior which you would expect in your particular work sit- 
uation.- TO OBTAIN A TOTAL SCORE, ADD THE. SCALE VALUE NUMERALS CORRESPONDING TO THE 
CHECK MARK. 
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Parts I & LI:/ Work Efficiency Scofe ^ 

I . Work 'Abi I ity 

1. .Handling fools and ^materia I s. . 

2. Following directions^. . . '. . 

3. Motor coord 1 nation- and movement 

4. Abi I ity to concentrate.. . . . 

5. ^ Quant ity of 'work . 

6. Quality of work" 

7. Recognizes' and corrects errors? 

8. Independence frdm supervision . 



J I. Work Habits 



I . 
2. 
3. 
4. 
5. 



Attendance » 



Punctual ity 

Care to tools and property, 
Thoroughness. 

Dependabi Mty * , 

I nitiati ve. ♦ 

Stabi I ity ... / 

Assumes responsi bi t ity . . . t 

Cooperation and willingness . . . '. ^ . 

10. # Eager to perform well ... . 

11. Attitude "toward supervisor's criticism. 

* ' \ 



7. 
8.' 
9. 



V 
» ♦ 



TOTAL 
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67 
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2 


3 


4 


Very Poor 


1 

s 


Tl 

Q), Z 

~\ 


Q. 


| Excel lent 



; 12. Attitwde toward co-workers 

13. Personal appearance., *. . 
, <I4. Honesty. ; 
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Parts 'III, IV, & V: General Behavior 



1 1 



Wi 
L 

2. 

3. 

4. 

5. 

6. 

7. 
8. 
9. 



Score 

thdrawn Behavior 
Stays by himself 



< 0 
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Shows no interest in anything. . . . 

Is depressed (sad, weeping).^. . . « 

Is very slow in movement 

Does not converse with co-yor^cer^ . . 

Does not respond to supervisor in 
sentences 

'Ignores activities around him; . . . . 

Does not smile orj.augh when expected, 

Sits still and daydreams \ * 



TOTAL 



A 
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ERJ£teproduc6d by permission of Ralph H, Song. 



VOCATIONAL 6EHAV-I OR CHECKLIST (VBC) 
EXPERIMENTAL EDITION 



< \ 

VBC was\e 



. r 

The VBC was Njeye loped by Richard T. Walls, Thomas Zane> and 
■Thomas J # Werrfer at the West Virginia Rehabilitation Research 

and Training Center and copyrighted in 1 978. ' t 

* * 

Th ^/BC provides a listing of objectives which can" be used to 
describe each client ! s vocational competence, to prescribe 
curriculum to. mediate deficiencies, and to evaluate progress. 

The VBC is an extensive list of 344 vocationally relevant 
♦skill objectives carefully specified in terms of conditions of 
performance, specific behaviors, and standards of performance. 
The objectives are classified and presented in seven categories 
as follows: prevocational skills, job-seeking skills, inter- 
view skill*, job-related skills, % un ion-financial -security * 
ski Its, work x performance skills, and on-the-job social skills. 
Optional data sheets are suggested as a way of monitoring daily 
programs of trainees. * v 

The VBC is designed to assess clients in vocational training 
and on-the-job training programs. It ca/i be useful in the 
following settings: state-federal VR, sheltered workshops, 
educational facilities, and rehabilitation facilities. 

The VBC is valuable to program managers, case managers^ clients, 
and a host of other professionals in rehabilitation, education, 
and training. Case managers responsible for wmting Individ- 
ualized Written Rehabilitation Plans win find objective docu- 
mentation^for legislation requirements as well as a means of 
goal setting which is responsive to clients? The VBC def i nes' * 
work and work-related skills clearly, specifies a broad ranges 
of work skills applicable to a wide range of jobs, sets , m , > 
clear standards for mastery of skills, and documents client - 
progress,. Directors of vocational training factl (ties, wf 1 1 
find an objective mean's to accountability, cost effectiveness, 
and appropriateness of programs and staffing. Also, the measure 
provides a means of outlining an objectiveTy specified 
curriculum for prevocational and vocational skills. The 
program evaluation specialist will find an objective means of 
documenting client or trainee progress, and accordingly 
effectiveness of training procedures. 

Subsets* of the instrument can be Used-. Only those skills 
perceived as relevant to the individual client are assessed, * 
and others ar^ omitted. This can be done without distorting 
*ariy global score of vocational competence because fhe instru- 
ment J s criterion referenced /specific behavioral competence) 
rather than norm referenced (scores compared to those of a 
nqrm group). Likewise, additional skill objectives can be 
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Administration 



Scoring < 



Written in a manner that carefully specifies the condition and 
Instruction, the behavior, and the ^standard. 

The VB£ may also be used to construct individualized written 
plans for other students, trainees, or clients as mandated by 
federal legislation. In education, for example, it can aid in 
the development of the Individualized Education Program (IEP), 
'"Which Is requThed for all handicapped children. It can also be 
used in the development of the Employment Development Plan 
(EPP), which Is recommended for all persons served by the 
Comprehensive Employment Training Act (CETA). 

The yse of the VBC requires professional judgment, but para- 
professionals may easily be trained. The VBC can be admini- 
stered as often as necessary to maintain art accurate view of 
» the -clients competence. In some instances a single assess- 
ment of skill objectives may be sufficient, but in other cases 
a periodic assessment of clientor trainee skills is desirable. 
Administration is achieved by observing the client; 'the time 
necessary varies depending on the number of objectives deemed 
appropriate for the individual client. 



( 



A Ski I h Sunmary Chart and a Skill Objective Profile are de- , 
veloped. The Skill Summary Chart is used as an overall record 
of all the skill objectives achieved by the client in all 
seven categories. The skills mastered by the client in initial 
assessment and in training, as well as the date the skill was 
demonstrated or completed, are entered onthe Skill Summary 
Chart. £or any skill objective mastered, a M + n is entered. 
For any objective failed in Initial assessment, a is 
entered. The date training was begun and the date training 
was completed (the skill was mastered) are recorded. The ♦ 
summary column provides a concise view of the skill objectives 
mastered In either initial assessment or training, and so 
summarizes the individual client ! s progress to date in each 
ski I I category.; ^ 

The Skill Objective Profile allows for a quick survey of 
overall client progress in eaph of the seven categories. The 
profile is constructed \by dtvi d i ng the number of skill object- 
ives mastered in * catggo/y by the total number of ski II 
objectives considered applicable ta the client in that category, 
multiplied by 100. The instrument is hand scorable. 



R6I iabi I i ty * , The VBC*was considered in terms of rel iabi I ity as stabj I ity and 
re I labi I Ity as interobsdrver agreement. Reliability as sta- 
bility was measi*red using test-retest procedures (two weeks 
between tests) for five vocational rehabilitation clieats 
observed by two observers. Five skill objectives were randomly 

% selected from each of the seven categories for evaluation. 

* Stab! I Ity across' a II seven categories ranged f rom 92£ to 1 00%. 
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The overall mearr stabi I Ity of the VBC was 97$. An indfcx of . 
inter^bserver reliability Was computed by comparing the scores 
of Observer \ and Observer 2 at Time I. Interobserver reli- 
ability across all seven categories ranged from 84^ to tOO/6. 
The overall interobserver reliability of the VBC was 95$. 

*- * • 

The content validity of the VBC indicates how well th,e skill 
objectives sample vocational skills. It does not- yiel_d a 
numerical value. Rather, it gives a clear definition of the 
universe represented and describes the procedure followed, in 
sampling that universe. Construction oi x the VBC began w»h 
more than 200 behavior checklists colJected from rehabilitation 
^facilities and scftools. Of these checklists, 2! which contained 

" items related to assessing .vocational behaviors were selected. 
Thus, the development of the VBC was baseXl on suggestions for 

• objectively assessing vocational behavior from a wide variety 
of training facilities and vocational training personnel spread 
over a wide geographic area.' The VBC is much more comprehensive- 
than the wisdom and experience of a single facility, staff, or 
vocational training group. Thus, the content validity of the 
VBC must be considered high.' 

Criterion-related validity was examined by comparing the VBC 
with various indicators of vocational competence perceived as 
important by employers: essential Job ski-Ms, desirable 
employee characteristics, important job-related behavior, and 
job retention skills. The criterion- related validity with these 
four sources was .95, 1.0, .96, and 1.0, respectively/ This 
yields an overall average criterion-related vajidity of .97. 
/ Thus, one can be confident that the VBC includes- the important 
and relevant vocational skills. 

A major advantage of the VBC is that the ski I Is to be assessed 
may be adjusted to suut the type of training and the individ- 
ual needs of the worker or trainee. 

Because skill objectives may be added, deleted, and/or changed, 4 
the VBC Is simply a checklist of skills (criterion-referenced 
measure); \|t is not a standardized instrument (norm referenced). 

University of Florida Rehabi I Itatiqn Research Institute, 
Gainesville. The vocational behavior checklist measures client . 
" abilities. Rehabilitation Brief: Bringing Research into 
Effective Focus, February 15, 1980, 3 (3). 

Vtelts, R. T. & Werner, T. J. Vocational behavior checklist.. 
Mental Retardation, August, 1977, 30-35. 

Walls, R. T,, Zane, T., & Werner, T. J. The vocational be- 
havior checklist (experimental edition) . Dunbar,' WV; Research 
and Training Center Press, 1979. ' , 
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Availability 



Copies the ^check 1 1 st and other* pert i nent information can 
be obtained from — 

*. fv - 
*''. " ''Publications Department 

* ' ^West Virginia Rehabi litatlon 

. Research and Training Center 

_ • '-One Dunbar Plaza, Suite E v - 

^Dunbar, WV, 25064 
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SAMPLE ITEMS 
VOCATIONAL BEHAVIOR CHECKLIST' 
Experimental Edition 



PRE VOCATIONAL SKILLS 

Color Porting 14 j 

Condition: Given ten objects of one color, ten objects of a second color, 

and ten objects of a third color (all of various shapes _and 'sizes 
mixed together), ana three coritai ( ners. 

Instruction:- "Sort the objects by color Into three containers." 

Behavior: Client will .sort the objects by color»into three containe'rs. 

Standard: Behavior within five minutes on three of four occasions. The 

three different colors must be sorted Into the thffee confajners 
with no errors. 

JOB-SEEKING SKILLS / 
Want Ads 7 ' . 

Condition: 



Instruction: 

Behavior: 
Standard : 

Resume . 16 
Condition; 
Instruction: 
Behavior: 

Standard: 



Given the classified advertisements of a newspaper containing 
a minimum of^ ten job openings and/or notices for on-the-job , 
training. ... 

"Point to three* different ads for job openings 'or on-the-job 
training.", 

CI ient.wl I I jjpint to three di fferent ads. 

Behavior within three minutes on three of four occasions. Each 
of the three ads must be different and state an. opportunity for 
employment pr training. . p 



«Gtiven a sample copy of an employment resume. 

"Write a resume about yourself following the format of thfy samph 
Client will write a resume following the format of the-sample. 

Behavior within one day. The^resume must consist of accurate 
Information In each of the following areas: (I) name, address'*, 
telephone numffer; (2) age^ date of birth; (3) sex; (4) c marLtal 
status/ (5) Education; (6) work experience;' (7) 4 £pecial skills/- 
abilities;, (8) Interests; and (9) references ml ni mum of .three 
persons — ngmes, addresses, telephone numbers).' * 4 



INTERVIEW 'SKILLS 


•73 

« 




Work Experience 


14 


Condition: 


Given a simulated* job interview and ten different questions 
related to previous- work experience, current skills, ^education, 


• 




and personal Interest and goals. 


• 


Instruction: 


(Interviewer asks ten questions related to the above areas.) 


• 


^ Behavior: 


CI ient wj I 1 -verbal ly answer al 1 questions. 




S+andard: 


Behavior within 30 minutes in four consecutive interviews. 




* « 


The answers to *the questions must be in agreement with the 
information on the job application. 




* T5/0RK PERFORMANCE 


SKILLS ? 




*i Confusion 14 






Condition: 


Given a situation in the, work setting or part of the job with 


t 




which the client is unclear as to how to perform. 


1 nstrufi'fion: 


(IfTthe natural situation, this behavior should occur with no 






instruction. Use this instruction onl7 if training is required 


.) 


— - 


"When you come to something you don't understand, contact a 




* 


co-worker or supervisor." 




* * BeHa>for: 


Client will contact a co-worker" or supervisor. 




Standard: 


Behavior within five minutes on "four conseci^j^e occasions. 






Co-worker or supervisor must be contacted before work continues 




ON-THE-JOB SC&IAL SKI LLS . j 


* 


* Supervisor lo 


i - 




Condition: 


Given only the verbal instruction. 




* 

1 nstructi6ri: 


"Who tel Is you what to do at work, and who do you as*k if you 
" have any questions?" . # . 


J 


Behavior: 
« 


Client will point to and/or state the name of s his/her immediate 
supervisor/ 


* 


.Standard: 


BehavTor within ten seconds on four consecutive occasions. * 






, Person named'or pointed to'must"^e the immediate supervisor 
of the cl i ent. 




> 

* 

» 


i . , 

<• 

• 

* * 

* 


• 
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Reproduced, by permission". Copy r i ght (c) 1978. Richard T. Wal Is, Thomas Zane, and 
: Vn ^ Jhomas J. Werner as the Vocatlona l» Behavior Checkl 1 st (Experimental Edition.) 
~tl\lLfe~ rsi- , v " - * ( 







THE VOCATIONAL DIAGNOSIS AND ASSESSMENT OF 
RESIDUAL EMPLOYABILITY (VDARE) PROCESS 



The VDARE Process and the VDARE .Worksheet were % deve I oped by 
Timothy Field and Jack'M. ^ink, bqth faculty members in the 
Rehabilitation Counseling program at the University of 
Georgia, in* 1979. „ \ * i 

The VDARE Process Is designed for job analysis and the 
assessment of voca'ti<*i$| potential. 

The VDARE Process ' use^ the Dictionary .of Occupational Titles 
(DOT) and the client's personal history and current. level of 
functioning as information (medical, psychological, social, 
educational, and vocational ), is synfhesized to predict 
vocational functioning potential. .The client's work, his- 
tory provides the basis* to build an assessment of client 
vocational functioning capacities. This is ^accompl ished 
by attaching the'job demand characteristics* of the client's 
work history experience Xder Wed from job analysis informa- 
tion on; these jobs, using the DOT) to the client' as indica- 
tors of his/her demonstrated functionjng capacities. 

The Process is outlined inthe following fiye phases: 
(I) initial collection 6i ' vocationa I ly relevant back- 
ground data; (2) tracing client's vocational history 
through the DOT and collapsing the trait-factor profiles 
from this ^history into a single Unadjusted Vocational Pro- 
file (UVP); (3) alterations the UVP, trait-by-trait, to 
reflect the impact of the vocationally Ye levant -c I ienf dafa 
which results J rv a tentative Residual Emp loyabi I i ty Profile 
(REP); (4) formulating an evaluation plan to collect the 
necessary medical , psychological, social, educational, and 
vocational data needed to clarify and finalize the REP; 
(5) iselectjj)<} % the vocational objective(s ) , plarwing services, 
and completi$fHhe VDARE Technical Data Report. 

The Process Worksheet is j& four-page display device used to 
'compile and present the* i nformation processed. Page I is" 
used to record refecral and interview data, especla I ly- the.. * 
client's work history. Pag^2 and 3" include the VDARE "grid" 
for job/client profiling and stece for key, reference notes con 
cernlng d if ferences^ between UVPTtod REP. The grid* contains 
space for DOT codes* and job tit les^Guide to Occupational 
Exploration (G0£) Code and worker trait> information for each 
job; JJVP, including traits to be clarified; REP, including 
documentation references; job possibi 1 ities;^ and vocational 
outcome. Page 4 provide? space for objectives and methods 
for the evaluation plan and service plan. 
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Use ~ ^ The^process seemk, appropriate for assessing all clients. r It 
\ seems to be useful In assessing clients In rehabilitation 

c facilities, educational facilities, public and private rehab- 
11 ItatlCn set+Ings,* and In the assessment of -Injured workers 
(e.g., Worker's Compensation, Social Security). ,lt is also 
x * applicable to non-handicapped individuals. 

The VDAR£ Process can aid case managers and 'other. rehabMI- 
\ tation professionals in translating client/employee case data 
I nfq more meaningful terms. The* REP Is beneficial in Several 
ways: Irprovides a convenient way of Identifying and specify- 
ing necessary c I Tent evaluations; It provides a convenient and 
„ efficient method of Incorporating evaluation results in the 
selection of vocational objectives; and it can be used to 
determine services necessary jx> bring the client's present level 
of functioning into* line with the level of funpttoning re- • 
quired for the most feasible job. > % 

-* 

,The x process is also beneficial to program managers. The voca- 

-* tiona I -outcome -prof He-contained in t-he~ VDARE "art tf afris in 

planning and^f InaNzing follow-up services. The vocational 
profile outcome data can also be used for program evaluation 
•and^other research endeavors designed to*enhance service 
delivery. 

The developer^ of th e Process indicate it is useful for voca- 
tional guidanc^and counsel ing services in schools and person- 
nel screening in^buslness andliQdustry, as well as for training 
and promotional practices. \ 

Administration The completion of the process" re I ies on the client's self- 
report, and clarification of work history ancf professional 
V" judgment. To administer the process and complete the 
, l " Process Worksheets the user must have a functional under- 
standing of job analysis and ~be trained In the usfe of the DOT 
(1977 edition)* The procedure relies on personal/ interview 
and review of the compiled data and should take about 30 
J — minutes to admFnlster.. 

* > 

Scoring No scoring Is involved* The VDARE Process organizes 

synthesizes pertinent client Lnf orma'tlop. 

Rel [ability The ^rel letvH Ity of this process' is dependent upon the accuracy 
of the client f s self-report and related consultlve data. 

Validity ^The validity of the VDARE eProcess t*ests on ^ hej^ idity of, 

tije data- base used. While local job analysis data are ideal, 
DOT data can be used when local data are unavailable. The 
validity of .the. REP* rests entirely on the professional) judg- 
. ment bf the VDARE, Process user and the clarifying, data the 
' * user- secures from allied professionals. 
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Advantages , 

Limitations 
References 



x 



A major advantage of the VDARE Process Is that It compliments 
existing evaluation systems and techniques*-^ 

The procedure seems to rejquire a cortsiderable amount of time, 

Flejtf, T. F. & Field, J. (Eds.). The classification of lobs 
according to worker trait factor: An addendur/tQ the 1977 
edition of the dictionary of occupational titles . Athens/ 
Georgia: The McGregor Co., 1980. 

Field, T. F. & Sink, J. Vocational assessment and jobs . 
Athens, Georgia: TheTMcGregor Co.,' 1981 . \ 

£leld, T. F. 4 Sink* J, The vocational expert . Athens, 
Georgia: Burman Printing, 1981. 

McCroskey, J., Wattenbarger, !W. , Field, T*. F., 4 Sink, d. M. 
The vocational diagnosis and assessment of residual employ- 
abl I ?ty - in brief . Roswell, Georgia: . VDARE Service Bureau 
1978. , - 



. Vander Vegt, D. & Field, T.F. Labor market access^ stfthens. 
Georgia:, Burman Printing, I98l^\ * 

% * - , 

^' ' A list of additional references can be obtained from the 

VDARE Service Bureau*, Inc. (see Availability section for 
the address) . / . 

** 

Availability Material? related to the VDARE Process are available from — 

VDARE Service Bureau, Inc. 
P.O. Box^/^945 
Athens/GA 30603 
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SAMPLE ITEMS * 
VDARE PROCESS WORKSHEET 
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Vocational I v Relevant Inforroa-'cr , (Medical, Social, ** 

"Psycho I og ' ca \ , Educa-Konai I . rrationai ) 



V 



\ 



Reproduced by permission* Copyright <c) ! 928 by Billy J. 4 McCroskey, William Wattenbarger, 
^'"othy R. Field, and Jack.'-!* Sink* All rights reserved (USA and Canada). 
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Developer(s) ■ The WATfF was developed by James A. Bitter and D. -J. Boianovich 
^ at th-e/Jewi sh Emplo.yftent and Vocal-iona I' Services in St.,Loui J s, 

Missouri, from 1966 - I|68. ' / 

Purpose • * The WARF is designed to measure work readiness and to predict 
' 'job adjustment in mentally regarded workshop clients. v § 



Description The WARF is. 'a 4Q-vitem rating scale which purport^jfo assess 

. * observable work, behaviors. It contains eJ-ght subscales artd 

* m * each subscalat)a$ five items. The five.ijems represent different 

level^ erf j>erformance ranging" from low 1j£ high. Each item is^* 
-i rated by checking "yeg" or^ ,f no. ir Are&s investigated by the 
^ eight subscales are as follows: .amount of supervision' re- 

. ; * • ^ quired, realism of job cjoals, tteamworR, acceptance of rules 
f or authority,, tfork*toferance, perseverance in, work, extent , 

tratnee seeks ass4 stance, . and importance attached to job 
* " training. *-i .V.* 

.Use - The "WARF is designed to assess mental ly 'retarded 'clients parti-' 

. ci(>ating in workshop settings/ The case manager cao use, the > 
WARF to measure the strengths and weaknesses of workshop 
partfci pants, .to formulate rehabilitation objectives, and • 
j , )' w to assess; progress toward atfaining these objective^,^ - y 

' • * w Program managers find it* useful* for program planning and 

evaluatiorff^ 9 * 

Admin*i|>trafton Professional 'judgment required in rating workshop trainees. 

'Th^yjdter can* administer the WARF fn three, to seven minutes 
&\ after acq uirj^g reasonable f amM iarfty with the client. 
r : * r (Three weeks of observation is^aA appropriate period of 

"time.) Wnen assessing individual, trainees it is recommended 
> /fhat'more/tnan one rate.r jj^rtjci pafeand interpretation^ *be 
* ' : made caiyf ious ly.- ' - ' ,v r 

Scoring ^. A tota-UscprQ is calculated which consists of cumulatJ^lft. [>psi> . 

, tive response^.- Since thfere are positive "yes 11 Bnd positive 
"no" responses, theuse^of a scoring ^ey facilitates accurate 

* " - o and convenient scoring, Positjve responses are Identified jn > 

. t , the manuaJ; therefore, constructing -a scbHng key i^simple. 

* / • .* * W£th the use of a Scoring key, the WARF can be hand Scored tt 
s > * in about ffve minutes. * . 

Re^iab^tty An analysis : of \ferian£e technique was used to determine an 

.estimate ojyre I tab-i 1 1 ty ; ■ tt was used to compute the average 



/. * • ' " interconnection of, the four raters rating 26 clients for 

^ * ' - ' bofh atfjusted^ad unadjusted -WARF rati ngsf^Coef f Iqjpnfs of 



H v \r\t&fTaier agreement were" fc^ind to be quite high, wittt a 

*reliab fifty coefficient format i ngs (>iof adjusted for rater. » 



bias and .94 for adjusted r^fings.^ 
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Another look at interrater reliability examined the interrater 
correlations of*th,ree counselors and one workshop foreman 
on a totaf of clients. Product-moment correlations between 
the various pairs ranged from ,67 to v 98/ .indicating fairly, 
high agreement regarding the rank ordering' of clients. 
However, interrater agreement on absolute scale va-I ues 
m % indicated that there yas a signif icant* difference (£<\0I; 
i test) in the mean score assignee! by the workshop foreman 
/ m ' and % the nearest counselor but there were no significant 

differences among the counselors. It appears that the workshop 
foreman was rating from a different polnt.of reference. 

* The validity of the WARF has been evaluated using four raters 5 
c who evaluated the same sample of work ad^ystment clients J 
(N[ = 26). The ratings were made after knowing the clients a 
minimum o.f three weeks.' The predictive validity of the 
WARF was evaluated by correlating .these ratings with a 
^measure of successful j'ob adjustment. Follow-up information 
was collected for theTlampIe for a period of two and one-half 
years after rati-ng^ werl made, and the' criterion of success- 
ful job adjustment was cqnsid^red to be a minimum, of six \ 
-months of continuous employment. Ratings were adjusted for 
bias using^ an analysis of variance technique. (Three types 
of rat*er errors were 'found. These errors were- Leniency and 



to 



sev^teity "errors, halo error, and a rater's general tendency 
over- or undervalue certain subscales. Hence, the WARF 
.ratings are subject to rater bias,)* Predictive validity was 
found to be somewhat, usef u I for group predictions'as a result 
of a .56 coefficient of correlation with job adjustment 
criteria. . 

* ; , * 

Using the WARF is beneficial because Tt provides a H 
eonvenjjen^fc, quick', and inexpensive method t:o assess clients. 



Limitations 



References 



The WARF is subjapt to Jnd ivi\jya I rater bias which can 
significantly affect i ts -pred ictive validity,. However, -rater 
'bias, does pot significantly affect the mean* predict) ve validity 
or the rftean reliability estimate. 

, Bitter, J. Ac " .Bias effects on. validity and rel iabi I ity of a^ 
ra^Jhg scale/ Measurement and EyajjJatjdn^in Guidance , 1970,° 
3 (2), 70-75., 




Bitter,' J. A.. &' Bol anovich, D. J . WARF: A scaJe for 
measuring job-readiness bet^nors. ' American Journal .oj 
Mental Qpf Kclency; J970 74 (5). 616-621. " . 
; ^ \ * 

Esser,' T. J. (Ed.). Client rating instruments for use M-n 
vocational rehabi I ? tation aqenci es . Menomonie, Wisconsin: 
Materia I s development Center, University of Wisconsin - Stout, 
1975." v ; 
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Avai labi I Ity 
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Additional information, Single copi'es of the WARF, and per- 
mission^ reproduce the WARF can*be obtained by writing to 

- ' . " l~ ^ 
James A. Bitter -* 1 
< - School of Business A * 

University of Northern Colorado 
Greeley, Colorado 80639 

\ 
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. - , - SAMPLE "ITEMS "'•« - > 

WORK" ADJUSTMENT RATING FORM^ _ 

INSTRUCTIONS: '.*-•. • • 

the Work Adjustment Rating Form is a rating scale consisting of 
Items rejating to observable work behaviors. „You are asked to answer 
ach item either "yes" or "no" "for the, trainee identified-* on the form. 
Some items appear very simrlar, j Answer each item. Please do not- 6m it 
agy Items. 1 * * ^ < 

fc Mark your response with an "X"' over your choice. 
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1. -Wil^t training and direction, trainee can work 
S ^dependent ly under occasional supervision. 

2. Trelrtee' has 'developed realistic job goals and 
, readily seeks counsel in planning. 



3. Trainee can work with /-only one or two others 
whom he particularly likes. 

4. ^ Trainee knows and usual ly *fol lows rules 

withouj reminder* 

Trainee becomes frustrated ^and gives up 
easily on almost any job. * . : 



5 



Trainee generally stays at work* but is 
easl ly distracted and r loses interest. 

Trainee seeks assistance only on bonafide 
% prob terns -and' after attempting 'to.solva^ 
them himsetf. 



y 



8. Trafnee desires wOr^k but tloes not do anything m 
himself to find ft. , N ; 

9. Trainee catches on easily and does his work rv . 
with practically no supervision. Xj 



10 



\Trafnee cons fliers job plans but they are not 
compatible^ with his abilities*. - r 



II 



Trainee works effectively in small (2-3) groups. 



12. Trainee shows open hostility %o authority 
and rules. \ 

13. 'Trainee generally works at routine Jobs 
readily wifhout resistance. 

\4*. 'Trainee Is a ^persTste'nt wdrkep on al I ass^lgn- 
' menrs, even under adverse circumstances. 



Y 
Y 

.Y 



N 
N 
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* 15. Trainee generally, handles own problems with 

t /jT only occasional help, 

m ,X ' 6 \ fr a ' nee expresses interest [a future work,' 

but not in a job now* 

•» * ^ • ,# 

17* Once shown what he must do, trainee applies 

J himself diligently without much supervision. 



Trainee has begun to think about possible 
occupations for himself that are within his 
capabi I i ties. 



19. Trainee is un^>le to w/brk^f fectively with 
any others. I 

20. Trainee understands rules and regulations 
and adheres to them consistently, 

* 

21. Trainee tries simpler jobs but usuajly becomes 
discouraged when he encounters changes In 
routi ne. 



22. Trafnee appl ieiNAimself diligently tot? almost 
all fel nds of work. 1 

23. Trainee freqt/ently seeks help and attention 
for personal as well as work-related problems, 

24. Trainee wants a job and seeks assistance in 
trying to prepare for one* 

25. Trainee works w>*k Ji fficuity, even under 
constant supervision and after getting 
considerably training. 




■ Reproduced by permission of James A. Blfter* 
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, DevelQper(s) 

Purpose 
Descri ption 



The Work Report was 
St. WuLstan 1 



Use? 



t 



Admini stration 



9* v 



Scorj ng 



Re'liaSiKlity 



introduced in 1961 by Roger Morgarrof 

s Hospital , l ,Ma I vern, Worchestershi re, and re- 
vised > J n, v l 966t-~^y Morgan and A.., J. Cheadle. The revised 
version was- reappra ised in 1972. 



The Work Report ' is an instrument designed to assess the client's 
work performance. 

The scale contains 16 polarized items which reflect elements 
of work ability (e.g'., grasps instructions quickly - cannot 
grasp instructions, does complicated tasks - can do only 
simple jobs).- The positive descriptors are labeled A and 'the 
negative desc rip-tors are labeled B. It is a five-point 
scale (i.e., A, inclined to A, midway between A and B, in- 
clined to B, and B). The area investigated by thd Work 
Report is work ability, which consists of several elements w 
(e.g., speed §p^qual i ty V>f work, need for andfr-^^i tuie toward 
supervision, skill with hagds and 'tools, wi I I ingnessro work 
and change jobs, etc.). 

The scale is designed to be used with psychiatrical I y disabled 
'clients. The information provided ^by a series of work reports 
is beneficial to case managers when working/\/ith clients, 
placing them in suitable employment, and informing prospective 
employers about their work abilities. It may also be bene-* 
ficial as an indicator of rehabf I i tation gain in sheltered 
workshops, rehabilitation facilities, and otl^r rehabi li ta- 
tion programs. * t 

The scale can be administered' by a variety of persons (e.g^, 
^nurses or employers of cJients who leave the rehabilitation - 
setting for the day to work). In order to complete the 
scale, the rater must be able to observe the client's work 
'and make a judgment about" hi s/hefc-^erformance. The scale can 
be used to assume the client's wopk ability with various types 
of jobs and over any desired^time period.; Its developers 
generally use it 3£ weeks 'a'fter the cl ient>fenters the program, 
prior to case conferences, ' and, when the client changes jobs. 
The time required to complete; the scale is approximately 
three minutes. ' 



Each" item has a score th&t can range from 0(A) to 4(B). A 
total $core Ps derived by summing the scores for each of the 
sixteen items, and it can range from 0-64. The lc|Wer the 
score, the better the performance. \^ 

Tffe Interrater reliability of the total score was examined - 
^ as six nurses, rafed ten patients) on the > same day- The.*six - 
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} raters produced 15 pairs of ratings that could.be correlated. 

Eleven of these pairs were significant (£ < .05), byt six 
of these significant correlations indicated that the means 
of 'the total scores ^being. compared Were found to be signi- 
. / ficantly dffferenf; Additional >)ri a js in a different workshop 

were set up with forma) instrUtsfW.on the use of the form 
given- between the two trials. Theresas ,no improvement y^L 
the number of precise agreements. Herhb^s ' further instruc- 
tion and experience wou4d improve this situation. „ ■ 

An examination of the Interrater rel i^bilifry of individual 
Items on the form found 45? tofal agKeSmenf by a I I of the 
raters on all of the patients! ratings. Agreements 4o within - 
one point on the'f ive-point scale increased this fvyure to 93?. 

Val,di+ y • Concurrent val'idity was examined by correlating'inpatients 1 ' 

average pay (based on piecework payments) and work scores 
for the same time period. 8oth samples studies (ts[ = 56 
and N = 3CW yielded significant correlations (rho = .416, 
t = 3.33, .01 > £> .001 and rho = % 464, t = 2^76, p < .01 , 
respectively). 

i 

"Predictive validity was studied by looking at predischarge 
— work scores \n the hospita-l and subsequent-success or fai \xrre — 
in opfen employment. Seventy-eight patients (or 95?) who had 
been discharged and on whom Work Report ratings had been made 
prior to discharge were followed-up. "Success" meant that 
the person had started a job in open employment within four 
weeks of discharge; was .still working six months after dis- 
charge, although not necessar i ly ,at the same job; and had worked 
without a break of more than two weeks. A signif icant -associa- * 
+ ion was fou/id between the mean total scores (£ < .05) and 
between the mean scores of 5 out of the 16 items? The * * 
significant items denoted persistence (£ < .01 ),♦ e.agerness to 
work (£<.02), welcoming supervision (£ < .05), initiative 
j (£<»0I), andi getting along we I I with others (£<.0I). 

Advantages The Work Report is usqfut fof recording and Icommun icat in£ 

information about a patle'TfiHs* work performance. The blank 
reverse of fhe form is cpnvenient for keeping a daily or 
weekly running rec<?rd. the supervisors awareness of an 
Impending obligation to compIeteHhe form tends to focus- 
ahd sharpen .his of her observation. The Itemizing of the 
several .factors involved In doing a job serves to educate 
the inexperiencedj supervisor and helps him or her to produce 
a more complete report. 

Limitations This jneasur^ has cor^ratively low ihterrater reliability. 

References Cheadle, A. J., Qushing, D., Drew, C. D. A.," and Morgan, R. 

The measurement of the work performance fof psychiatric 
patients. British Journal of Psychiatry . ' 1 967. M3, 841-846.- 
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Cheadle, Ay,J. and Morgan, R; The measurement of ftork 
performance of psychiatric patients: A reappraisal. Bri 



Journal of Psychiatry , 1972, \20, 437-441. 

The scale and/or additional information can be obtained 
from — 



Dr.. R. Morgan, M.R.C. Psych. 
Director of Rehabi I itation 
St. Wulstan f s Hospital 
Malvern, Worcestershire WR*4 4JS 
Great Britain 
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WORK REPORT 



NAME 



UNIT 



' PER f OD COVERED 
WORK DONE 



TO 



V 



Q) : 



3" 
0~ 



13 



> 

cr 
O 
c 



a. 
f 



3 

•Q. 



CD 



OD 
CD 



L, Does complicated J^bs 



Can ortly do simple jobs* 
\ tX- 



2. Grasps instructions 
quickly 



Cannot grasp instructions 



3. Works, very quickly 



Works very slowly 



4. Works continuously 



Work's for short periods only 



5. Eager to work 



Avoids work' • 



6. Welcomes supervision 



Resents' supervision 



7> Needs no supervision 



Needs constant supervision 



8. . JWHMng to change jobs 



Refuses to change jobs r * 



Looks for more work 



Waits to be gi very work 



10. Always uses good 
judgment 



Never uses good judgment 



1 1, Excel lent. standard of 
work 



Bad standard of work 



12. . Ski Hfui -with hajjds 



Clumsy with hands 



c Q. Use 'too I s/equ J pment 
%K we I r 



Cannot use tools/equipment' 



14. §ets on we 1 1 ^with 
other peop I e 



Gets on badly with other 
peop 1 e • 



\ 



1 5, ^ Communicates 
spontaneous ly 



16. Never arrives late 
or leaves early 



T01AL 



REMARKS 



o 

Cl 



> 

cr 

O 

c- 

-+ 



Q. 
I 



3* 

O 



Q. 



CD 

•o 
•o 



Does -not communicate 



A I way arrfves late and 
leaVes early 



GRAND TOTAL "(0-64) 
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Supervjsor_ 

i 

Date ? 



© ^eptpduced fry; pwm t^ss Jon. of. Roger Morgan, J> 
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MEASURES OF INDEPENDENT LIVING SKILLS 



* * 



- f 



1er|c 



J" 



i. 



v. 
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Devefoper('s) 



Pyrpose 



Descr iption 



Use 



BARTHEL INDEX ' , 
GRANGER ADAPTATION 



The Barthel Index (Qrlgiaally named the Maryland Disability . 
Index) was developed by F. I; Mahoney and D. W. Barthel 
* in 1955 and mo^ffied by Carl V. Granger in the mid 1970's. 

This scale, a measure of functional limitations, .assesses the 
degree to which. a person can function independently in* 
perform^ activities of daily flving (ADD, including self- 
care, mobility, and bladder and trowel control. 

The jnde# is a behavioral ly anchored scaje containing *I5 items. 
The areas" investigated include the following: feeding, bathing,/ 
grooming,, dressing,' toi let transfers, chair/bed transfers, 
ambulation," stair cl imbing', and ,bl adder and bowel control. 

The Index is designed for use with physically dfsabled clients 
in particular. If was originally developed for use in hospital/' 
rehab Mita^Ion settings^ but has been-widely used in other 
settings, such as'state VR agencies. 

The index may be useful' to case managers in providing a quick 
reference that, can tfe used to help indicate general patterns 
in improved # c I ient functioning personal* AQL and the 
general level of assistance a client needs. It may also be V - 
useful in determining tjie functional prpgnosi s -prior to stroke 
rehab i I i tat ion lany in studies* of cost effectiveness. 



Administration 



} Scorinq 



/ 



* Re fi ability 



Serlc 



3 \ ^ 



V 



--•-<?v 



In completing the Index it is necessary to observe or interview ^ 

the client or el se -interview profession^ Is^w&rki ng with the 

clfen.t. Minimal professional judgment is needed. 

• - y " 

.Th£ value erf each item is based on independence versus need 

for assistance by- the patjervt in performing 'an activity. The 

preferred scoring systejn consists. of *fourV levels of rat/mg'on ' ■* 

'the dependence - independence continuum^ (A ^hree- level system : 

can be Used when, raters are not optimally trained or ratings are /- 

compJeVed by telephone or i from the records.). The higher the - score, 

the*hjgher the "degrWqf indeperf<3e*n|a. A, zero score indicates, 1 

complete dependence. A tot a J scorJ^s* calculated by 

summing the ratmgs of the 15 items, providing an indication of 

the -severity of* the disability. The rangex>f possible scored 

and the corresponding severity classifications arenas follows; * 

. 0-20, . total Jy : dejWident; 21-60, severely ^epepdentj, 6"f-80*, \ ' % t 

njoderatefy. dependent- 81-99, s fight I y dependent; aniM0t) v ^ v 

independent. T^e Index can *ba completed by hand and % a* severity 

of di^g£jrf**^sco re* obtained^ lt\ approximately five minutes. 

Three hundreckaad seven -severe 1-y dj^5aj)»+a4 ll adujts, former 
patients a*fclQ gecxjrap^icaJ ly sefe 
rehab i I W*at i on^ Centers., were stfb^e 
tffe Barthel index was administered, 
was .89 and* int^r»bder re I iai|i I tty\£$ 



:ted comprehensive .medica I 
:ts in a s}hudy' in wfrich. 
1 * Test^retest re I i ab M i f y* 
above ?95. 
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i 

The use of^the Barthel index as a functional assessment instru- 
rrtent measuring personal care need was examined in a study 
of &9 chronically ill patients who were I i vi ng , at horne jbut 
receiving Bask:. Qare services. On an individual basis, the 
Bart he I score was correlated with the total nufcber of tasks * 
observed that the individual coul^l perform independently. 
<There was a ,91 correlatiOT, significant at the .00001 level. 

On a group basis^, -the Bart he I score was correlated with the * 
level of support needed to perform each of a number of tasks for 
the group as a whole. Moderate of strong associations were 
found for most personal care tasks,. Of the 44 tasks that had . 
at l^ast 10 applicable cases, 33 had significance levels 
of correlation with the Barthel score of £<.0€>l (correlations 
ranged frqnf.42 to .88). Also, a Barthel score of 60 seemed J 
to be'a cutting score; those scoring below^60 were capable^of 
performing no more than I'O tasks- in almost every case. 

* • " 

Bivariate GeJationships among various measures of patient 
need were determine) by a correlation matrix. The Ba rthet 
score had a number of stat i sjki ca I I y s s ign i f icant bivariate 
relatiqftshTps: ability to make decisions easily (-.36, 
P S •O 0 ')* ability to fulfill usuaj and customary .roles ; 
"(-.33, 2 <i*00\), presence of psychological problems (-.25 
and-.28, g £.01), and age' (-.26, t * 

Used properly^ the I ndex provides b measure of the clients 
level oF 'i ndependerice in personal APL. A second advantage 
is that j t can be completed quicklv/V. 

% Some of the I imitations, 9f the Barthel Index include the 
following: (I) it defines need for per^onaT cape assistance 
onlyK,(2) it must Be supplemented with other assessment^ for 
determining eligibility or developing rehabilitation plars; 
ancl (3) the evaluation provided does not detail the tasks to 
be performed in< f a Rehabilitation training program except 
categories that are assessed. 

Granaer Adaotation 



by the 



ForHnsky, -R. H.,- Grander, C. V., & Seltzer, G. B. The use o*f 
f unct iona I assesjspent in understanding home care'needs. Med i ca 1 
Care, May,. 1981, 19 (5), 489-497. 



Granger, C. V*-, Albr^cht, G. L., '& H^nfi'l^on, B.. B. Outcome of 
comprehensive medical rehabilitation:. Measurement by PULSES 
profile, and the BaetheL Index. "Archives of Physifcal "Medicine 
' and Rehabi I itation . April, 1 979,-150, 145-154. " * * 



Original Version/- Mahoriey gnd Barthel . * r . 

indices, Inc. functional I inii'fra'Hons^ J\ state-of-the-art review. 
^Fal Is Church rgl n i a': Authpr, 1.978. Tv P ' " - 
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Mahoney, F. I. &Barthel, D. W, Functional Evaluation: / 
The §arthel index. Maryland*State»Me<iical Journal , 1965, 
J4,, .61-65. _J T ~\T T - T -5 ^ ~' 

Addit'iona^information can be obtained from — *» 
Carl V. Granger, MD, pirector 

Brown UnFversjty/The Memoria 1^ Hospital ^ ♦ 

Institute for Rehabilitation and Restorative Care 
Family Care Centers v 
• 89 Pond Street ^ 
Pawtucket, R1 02860 fc , 



Maureen McNamara, Coordinator" 
Medical Rehabilitation Evaluation 
Fami ly Care Center 
89* Pond Street 
Pawtucket, Rl 02860 
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' BARTHEL INDEX .* 
GRANGER ADAPTATION 



The. fol lowing presents the items or tasks scored in the Barthel Index wfth the 
Corresponding values for independent performance of the tasks: 



1 ndependent 


Dependent 




1 


1 1 


1 1 1 


IV 




ntact 


Limited 


Hel per 


Nul 1 




10 


5. ' 


0 


*.° 


Hp i n k f mm <**im/Fp^H ■fpfvru Hich" * 
L/i i 1 1 rs II ^iii wup/ r ecu i i \j\ir u ) o 1 1 


5 " 


% 5 


y 


• . o • 




5* 


5 


2 


0 


©ress lower bodv 


0 


0 


-2 


0 


Don hrapp dp nrnQ+hpc i c 


5 * 


5 


0 


0< ' 


1 

ftpoom i no » 

j ui wiji i i ly ^ * 


4 ' 


4 


0 


-0- 


\ Wach r\r* ha+hjts V" 

\ na5n Or Da Tire 


.10 


|0 


5 

J 1 


r- 0 


Bladder continence 

* * 


ro 


; I0 


■5 


0 


Bowel c^nti nence 


4 


4 


2< 


0 


Care of perineum/clothing at toilet 


15 


• 15 


7 


0 


Transfer, ^chair 


6 


. 5 ' ' 


3 , 


0 


■ Transfer, to i let 


1 -' 


1 " . 


> 

0 ' 


> -o * 


Transfer, tub' or showe^ * 


15 ■ 


15 


10 


0 


/ Walk on level 50 yards or more * 1 
** > 


JQ 


10 


*5 - 


0 


Up and down stairs for 1 fH i§ht or i 


15 


• 5 


0 


V 

0 


Wheelchair/50 yds Only if not wa 



r 
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Reproduces by permission, of 'Carl Granger. 
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CALIFORNIA CLIENT GAINS SCALE 



Develbper(s) The Research Section of the California Department of 

Rehabilitation began to develop this measure in 1979 as parf 
of its Independent Living Research Study. 

Purpose This scale is intended as a measure' of change -in clients served 

. at "independent living centers. • . 
^ * ' / 

Description . This scale consists of 93 items covering d u em'o§raph ic and dis- * 
ability information as well as different aspects bf a client's 
fc life: financial skills, use of leisure and productive time, 
m activities of daily living skM Is, health skills and use of 
< medicaj services, social and psychojog ica I well-feeing, and 

m ' housing. (The housing items were not used in'the f i na L ana lysi s 
due to their ppor quality.) A variety of response types are - 
used: multi-point scales, agree/disagree, yes/no, and a few 
short answer fill-in^. 

' Use " The measure is designed' for use with independent living center 

c I i ents. ~ ^ • - 

- A shortened version of this scale has also b^en developed. . „ 
This California Independent Living-Survey will be useful as a" 
client outcome measure in various app I Rations with independent 
living centers. Except for a new housing scale, all pf the items 
were f aken from the original form. An item-total correlation 
analysis was used to reduce the scalp from the original form to a 
more practical 3Q-item scale, which can be completed in approxi- 
mately 15 minutes. A pilot study is currently underway. 

It ha£ been suggested that, the administration of the measure to a 
rotating, random sample of clients might be the most economical . 1 
means of outcome assessment for a statS VR agency to undertake 
(as opposed to the longitudinal approach described below in 
the Administration section). As sach it woulcf yield useful 
J s data for program planning and evaluation purposes.' 

Administration This is a se I f -administered scale to.be completed at intake and 

w x * a f +wo or more points , after the client has been receiving services 
\/ from h center at about six month intervals for perhaps 18 months. 



Scoring ■ , Coding values are assigned to each response* choice. Positive 
or negative gain scores Can be compT led^by ski I I arsa or as a 
M • corrtpci^ite of all of iv^e skill areas. Difference scores' for , 

group^of clients can be summed a/>d averaged* A* jf-test can' 
J then be used to determine if a sfgnffican? change has occurred. 

' • / 

Reliability A rel iabi I i %sf was conducted. from pilot test data gathered in 

two independent living centers in Southern Ca I i forn fa / After 
item analysis was performed to renjove ineffective scaje items, 
a Hoyt reliability coefficient of>.87 was- obtai ned. * * 

> -. "■■ ) •' 




Validity ' 



Advantages 



Limitations 



References 



Aval labi I i ty 



Two 'va I id ity studies have been conducted. The first compared' 
the gain scores for clients having achieved independence 
wi'th those of a sample of Independent living Renter intake 
clients. The developers Report that the 'results indicate 
tha.t the scale does 'measure independence $s the word '* 
is uSed^ in independent living ^centers* . * v 



The secpncT study compared the scores of independent -living 
center clients living in institutions with those of clients 
living>on their own. Again, the developers report significant 
Yfesults in the expected* di rect ion. . 4 

.The developers feel that the gains sbale may bf an alternative 
the functional assessment approach,, which they feel is not 
suited for*measuri ng client change in. the independent living 
setting. ( ^ 

The scale's length makes it foo cumbersome to be useful in 
ongoing outcome evaluations. 

•Research Section^ Californfa Department of Rehabilitation. 
Independent living research study . Working papers, 1981. 

Additional information on the Ca I i fornia 'CI ient Gains Scale 
*and the shortened version, tVfe California Independent Living 
Survey, * can be obtained from — 



to 



( 



Gene Hieh l,e 
Research Section 
California Department 
830 K Street Ma I I 
Sacramento, CA '95814 



/ 



oi^ 
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CALIFORNIA CLIENT GAINS SC^LE . 
SECTION 0 - Your Dally Activities . • • 

THE FOLLOWING ITEMS REFER TO YOUR ABILITY TO* DO VARIOUS THINGS WHETHER OR NOf 
YOU USE MECHANICAL AIDS. .EVEN tF YOU DON'T ORDINARI LY. DO THESE THINGS PLEASE 
ANSWER EACH QUESTION. • * , ' 

J • Ability to move around the place where I live (CHECK ONL^ ONE) 

I am^ unable to move around where I live by myselfor wi*th help/'" 
Leah move around with some help/ but only to take care of essential 
needs (example: use of toi let) . 

| 1 I can move ^around Inside and outside of where I hve with the help 

of another, person. 

I *1 1 can move around, inside and outside of where J live'without the help 
**of another person. . \ 

• * 
2. Ability to. carry out housekeeping work*(CHECK ONLY ONE) 



_ I can do all hou^^eeping myself. 

_ I can do most housekeeping myself,, with some help. 

_.l can do a little housekeeping, b#t only with another person 1 s* he Ip. 

_ I am largely unable to do any housekeeping* 



SECTION F - Your Social Life and Your Feelings About Yourself 
5. Aboyff how much of the time do you feel down or depressed?, (CHECK ONLY ONE) 



Very often 
Often 
Sometimes 
Seldom . 



f<Jh 



■ t 



• 6. Please check aJM of^he fol lowing activities .that you take part In 
regularly * - 

B Reading - magaztfie^, b^pok£, riewspapers, etc. 
Hobbies - stamp collecting, Model building, coin collecting i nve.'ntijjg, 

' repair work for amusement > photography, etc. » * * 

Crafts - sewing, leatherwork, woodwork, refinishing furniture, etc. ' * 
Arts - playing music, feting, drawing, painjiflg, creati ve wri t i ng, etc. 
Games - chess/ cards, backgamrion, etc. 

Outdoor Activities - fishing, hunting, camping., rafting, hiking, etc. 
Physical- A otlvltfes - swimming, basketball, bowling, racing, dancing, etc 
Other activities (describe) 



- 100 



( -1 
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PLEASE INDICATE HQJ^MUCH YOU AGREE OR DISAGREE WITH THE FOLLOWING STATEMENTS 
BY CHECKING ONE OF THE BOX& TO THE RIGHT OF EACH STJJEMENT. * , • * 



7. I take- good care of. 
' myseMf physical ly. 



8. 



I am -sati sf ied to be 
just -what I am. 



fy. I solve my problems 
' /"easi ly v . 

10. r am as sociable as I 
want to be. 

11. I am not the person I 
want to be. 

* * 

1 2 v I have^ one or more 
ab i I rfies in wh ich I 
\ be I ieve^ I am better . 
J than other people. 



Strongly 
agree 

□ 

a 
□ 



□ 



□ 



Strongly 
agree,. 



Agree 
somewhat 

□ 
□ 

□ 
• □ 
□ 

Agree 
somewhat 



Uncerta i n 

□ 

□ 
□ 

* 

□ 
Uncerta i n 



Di sagree 
' somewhat 



□ 



Di sagree 
sbmfewhat 



Strongly 
disagree 



□ 



Strongly 
disagree 



/ 



Reproduced by permission of the Research Section of the State of C8irfornia 
, Department of Rehabilitation. . _ 
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FUNCTIONAL ASSESSMENT PROFILE (FAP) ■ 



Tfie FAP was developed by /an i ntra-.agency task force within the 
Massachusetts Rehabilitation Commission in 1976. ^ 

The FAP is a §t<ide to the f denti f icat ion of a client's functional 
assets and Jia^bMi + ies in the rehabilitation process for 
use in clinical problem solving; it is not intended to be a ♦ 
rating sea le". > • ' - + " 

^Ten functional . areas related to the performance of work and 
activities o'f d^ily living are assessed through the following 
means: v open-ended behavior description; degree of limitation 
(i.e., asset, no limitation; minor limitation, <<?r ma/or limi- 
tation); compensation ti.e., fully compensated, partially com- 
pensated, no compensation now, or no possible compensation) and 
open-ended comments. The ten functional areas include problem 
sblving,- interpersonal, relationships, communication, *"sel f-care, 
object manipulation, mobility, 'time management, energy reserved, 
self-direction, and work.* 



This 'measure is appropriate for al*l .VR clients. However, 
because of the ti^me involved in completing the FAP, * its use 
may be limited to-'particularly difficult cases,* cases in^ 
Status 24, or transfer cas^s. Also, it is not necessary to 
administer the entire FAP to all clients; the most relevant of" 
the ten functional areaSr may be addressed* for a -given individual. 

The FAP is primarily used by 'counse lors in order to iafcilitate 
the rehabilitation process: conducting preliminary ^agnostic 
studies, determininq eligibility/severity, evaluating the ade- 
quacy of # the diagnostic £tudy», developing The/ I nd i vdua I ized 
Written Rehabilitation Program (IWRP)/and providing guidance 
an<3 counseling. Supervisees j ^ou I d find it useful far case 
eva I uatiop^'ana team consu Itatipn. K Vocationa T evaljfetors in 
k faci I iwCs tnay also find it useful. It is app^pdpri'ate as 
-a fr^^fibwork for clinical problem "solving dnd not recommended 
as a rating tool for program evaluation. ' 

Jhe FAP is completed by the counselor on the Functional Assess- 
ment Profile Grfcf, although £he client and others involved in 
thfe *cl lent 1 s rehabilitation <pn play a part as well. A UsWs 

•Guide is provided that induces i"fistruct ions, relevant defini- 
tions, possible questions to use to obtain necessary information, 
artd sev^pa I short -case studies as examples. The^counselor* 
should be trained in behavibral observations and familiar with 
the definitions, aftd' directions in the User's Guide. It is 
r§commend9d*tbat the counselor review an actual case with a * • 
person already trairfed.in the prpfile's use for greatest ease 
In uti I izlng the FAP. * 1 



The Jlessachusetts Rehabi I itation .Commi ss ion conducted a / 
training. proqranTfor vocational rehabilitation counselors using. 



1-02. .' * 
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Scoring \ 
Re I iabi I ity 



Val idity 



Advantages 



Limitations 



MC 



the FAP. The purpose w&s to Instruct the counselors in the 
use of the FAP for assessing client functioning 'and the incor- 
poration of this ^information into rehab i I i tat ion- planning with 
th^/IWRP. A Tramer^Guide, based on this program, is avail- 
able -for those who are interested* In conducting the^r own 
training. ^ § \ 




Assessments can be rfiade through the rehabi litation process In 
order to /nonttor progress toward. the clients goal.- Admini- 
stration time can vary from^a few rriinutes^to three ttours 
depending on the application 0.f the profile. A quick 
screening of- a case for information requirements or the" assess- 
ment of one functional area can take about 10-20 >m in utes. 
However,* sorting out aj*l of the informatioa acquired through 
a thorough diagnostic stucly i nto -f unct iohai capacities and' 
I imitations 1 and planning for the 'IWRP can fake up to three > 
hours. . _ - 

Since the profile is not a rating sEale or a test, there is 

no scoring procedure. t \ 

There is no evidence of "re I iabi I ity. Plans for such sWdies 
were discarded when the developers ascertained that it* was 
best utilized as a framework for clinical pYoblem solving 
rather than a rating instrument. 

There is no evidence of validity. Plans for such studies were- 
discarded when the developers- ascertained that 'it was •best 
uti lized as a framework for cl inica^ problem solving rather 
than as a rating instrument. , % 

* *» 

This system of functional assessment is flexible. It allows" 

the counselor to analyze and use/the information gathered on 

a client as it makes sense "to him/her. AIsq, a connection 

between the assessment of the client and planning fQr* treat- j 

ment is established through the compensation 'section. 

% » * * 

First, the assessment itself cannot be any better th^T'the 
clinical skills of the counselor doing the assessment • .( 
Second, use of -the profile demands comfort in expressing 
medical concepts in behavioral terms. ■ Third, the profile -is 
only useful as a clinical tool and not for program evaluation 
comparison. * . 

\ . . \ 

Fina4 report? NatJopal, short-terco train inq 

functional assessment profile f (RSA Training 

45-P-8I552/I-0I). Boston: Massachusetts Rehab- 



or statistical 



Langton, M, 
project on 
Grant No. 
i I itation 



S. 
the 



Commission, October, 1980. 



Marsh, S. K., Konar, V., Langton, M* S., and LaRua. A. J. 
Jhe functional assessment prof i le: A rehabi I itation model. 

urnal of Applied Rehabilitation Counseling, ,Fal I 1980, JJ_ 
(\), 140-144. 
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Avail a^flity 

7 ■ 


_ The 
can. 


FAP," including 'the User's Guide and the Trainer's Guide 
be obtained by" contact i ng,— " ' 


/ • - . : 

t 

% * * 

■ «• 




* 


Staff f Development Uni't 

Massachusetts Rehabilitation Commission - 
' 20 'Providence Street * * 
Boston, MA 021 16 > ' . 
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FUNCTIONAL ASSESSMENT PROFILE GRID 



J- 



FUNCTIONAL AREA 



QN|L 



I. PROBLEM SOLVING 

INTERPERSONAL 
2; RELATIONSHIPS ' 



V COMMUNICATION 



4. SELF CARE 



"OBJECT- \ 
?. .MANIPULATION 



6'. MOBILITY 



DEGREE 'OF 
.LIMITATION 



DESCRIPTION 



TIME ' ' 
7. MANAGEMENT 



8. ENERGY RESERVES 



7 



" 9. .SELF DIRECTION 



.105 ■ • " . ■ ' .; 

s 1 0. WORK . . • ' ' - * ' 

Reproduced by^permi ssipn. Copyright© 1 979 XA the 
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« A • FUNCTIONAL CAPACITY AREAS (F,CA) ' - . / *' ' 

( ' .'-V v ' ' ' . 4. ■••* . ^ 

Developer(s) The, FCA was developed by Horace Sawyer whi le sen/ing M a 

consultant to the Knoxville Area Comprehensive Rehabilitation 
Consortium, Inc.. ( KACRC ) . . The FCA was completed in 1976 
and' has been used in the s^vea agencies whicl? const itute #he . 
^ KACRC. . . . : - : 

Purpos|| The FCA was tfesignecf'ets a measure of change rn client functioning 

as the severely handicap^d inbjvidual proceeds ^through the 
rehabilitation process, <% ^ 

' & ' . / 

Description The FCA is ^n array of observable Yjual i ties or traits of .handi- 

capped clients referred to as "func^onal skills." It takes 
the form of a corttinuijm of these functional skills grouped into 
u categories called "strands," Each strSnd begins with the most"" 

primary skill and progresses dey^lopmenta I I y toward mo r£ complex^ . 
skills. The strands end with advanced functional ski I I s which 
closely approximate what society considers "approfn-i afe" or 
/ a «» usual adult skills for specific situations. " * , 

' A total of 39 strands are grouped into the f^lowlng nine skill 

"** areas: * basic skiTIs, physical capacTty, social skills, 'speech ^ 

skills, community skill 6ducatioti ski I Is, .vocationa I skills,, 
deaf skills, and blind skills.^ The number o\ strands in each 
*^ skill area varies f rom -fwo to nine. The number of skills,- 

* or items, in each strand also varies — from 20 to' 51. An 
exanry)le, the reading Strand in the educational skill area-, is 
pffered to Illustrate the progress! ve deve I opmeata I nature 
j of 'the strands. The initial item of fhe reading strand is '* ' 

* . "looks at pictures' in l book," item 13 is<"reads primer to sell 
aloud," and item 38 i.s "follows written instructions in 
sequence to complete.. an activity." 

.Use , - The FCA \yas designed to assess severely ha'tfcdicapped individuals 

( i .e. , jnenta I ly, behaviorally, and/or^-phy^ical ly handicapped # ~ 
young or older adults). It is appl liable in a variety of rehtfEH I !- 
tation settings (e.g., rehabilitation fapJ I ities, 'state-feldQra I 
; VRS, sheltered workshops, work .adjustment programs). , T 

Throughout the FCA 1 s development, an effort was made to^facili- 
Vate an 'Unstructured format, so that the *FCA would be^ useful to w 
practitioners in various settings. It c^n* be used by case 
^managers to Identify client deficiencies "artd plan individualized 
'programs of services. It c^n also be used by case manager* , 
and other rehabilitation personnel to Assess changes in the - 
client's functioning so as to modify/4-he client's rehabilitation 
s program when needed:' - Program managers are able to track the 

ppogress of cliSnts, thereby provjdlng an*"I ndication of program / 
* effectiveness. % • • . 
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Admin4 strati on Comp I etiQn^of the FCA reqqifes observation and judgment, but it. 

gan*be 4 cocnf$!eted* by anyone who is working wjj"h the client. 
^ !t can # be administered during evaluation and used- periodica I ly 
1 \ to rpas$e|s/tfte client -hjhrougfiout the rehabilitation process. 

The admi n i/stratjoh time off the instrument depends on the number 
of strands, that 'are being *app I ied to the' i nd i vi dua I . / ' « 

/ - 

Scoring- Scores, per se, are, not calculated; however, 'an FCA_ Profile and 

an FCA Manual can be developed. On the, FCA f?rc& i ley the 39 
.."^ • strands (e.g., reading, interpersonal relations, sex education, m 

work behavior I, job placement) are arranged' vertteaJ I y, and 
the skills (e.g., "looks at pictures," "reads s imp I e three/ 
* * letter words"Kare arrangecjfcdeve lopmenta I I y and hoqri zonljsrf ly. 
This ordering permits a two-dimensional display of the clients 
development. * The fwo-dimensional FCA Profile provides a 
perspective of skills which helps the trainer see 'i nteracfr ions 
and thus determine realistic and comprehensive object i ves „ for 
the client, as well as reflect the gOrrent functional' capacity 
level of the individual. * ' , 

The FCA Manual y ther second format, is used to determine func- ' 
tiona'l basel i nes- j and guidelines. Burinq eva I uation / the FCA 
Manual is OSed to determine a baseline functional ^capacity level 
on one o"r moj-e strand.^. * After evaluation, the Manual is used 
as^a guideline fpn adjustment services. Each strand is' one 
* r or more pages in- the Manual ^nd a data form -serves as a worksheet 
to record observations of one client^ i.n one straad. ^ 

The^uggested measucement codes for each skill injfhe FCA 
'consist of sjsven ^a Iternati ves that indicate the degree of, 
^ problem or asset, that the cl ierit 1 s functioning on that skill 
presents. m ■ ✓s , 

r /' % ' 4 * i 

^Reliability , The i^eliabjljty of the ^^CA has not been jdetermrned. 





Validity x 
Advantages 



The FCA has -not been^ val i dated: ^ * k 

A major advantage of the FCA is. ifi its use as ar\ai-d in mteT 
grating services: *lt provides a common basis to assist various 
professionals in .identifying strengths and weaknesses^of thfe 
multiply handicapped whfo often have not been served, 'an'd it 
focuses on individual client needs, yet provides a technique to 
research accountable service delivery to ^severely handicapped: 
cl ieifts. *• » v 



^Limitations 



References 



The primary limitation of the FCA involves a ladTcff fTeld 
testing to evaluate f ul ly 'the/feasi bi I i ty of apply ijng the 
measure to various rehab i I i tat ion, settings. 

Sawyer, H* V<. Functional capacity areas: Assd^sment, training^ 
and accountability . KnoxviLte, Tennessee: Knpxvi I ler Area 
Comprehensive Rehabilitation Consortium, fnc.^ t . . 
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«Avai labi I Ity * The FCA can * be obtained from — - • • 

• ■ ' : * ; X $} 
* v * Materials -Devejppment. Cfenter x . * ✓ ' * 

Stout Vocational' Rehab-Hi tat ion Institute 
\ \ University of Wisconsfn - Stout 5, 



■ r 



Menbmonie, Wl -54751 >■ . 
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IMPULSE CONTROL 



SAMPLE HEMS 

* • 

FUNCTIONAL .CAPACITY AREAS 




5. - Sits quietly for more than five minutes when 

group is attending to film, filmstrips, verbal 
• instructions, etc. 

6. Quiets down after actlVe period if reminded frequently. 

% 

* * M * 

7. Takes turns In activity 25-50$ of time. 

s . 

*8. Withdraws or becomes verbally aggressive for y C 
short periods when scolded, criticized, teased./ - ' 

9. Seeks attention appropriately by addressing ^ * ^ 

^others by name, not constantly interrupting, etc. 

ID. Accepts change* in rout! ne without emotional 4 * 

outbursts when reasons are explained. 4 

' ** 

11. Sits quietly for more fhan ten minutes when 
^group is attending to film, filmstrips, verbal, 
'instructions, etc. 

12. Takes turns in activity 50-75$ of time. " 

13. Attends to activity appropriate^ for 75% or, 

more of time. * ** * ' \ 

, A 

14* Quiets down Immediately after active period and 

awaits instructions. > v * 

15. Control phys Ipa I responses when angered. 

f6. Changes activity without -emotiona I outburst 
when change- i s^wjnounced* » 



'17;* Displays affective behavior (e.g., -laughing, 
crying) appropriate for>jltua^lon/place. 

^--~f ^3 i -- _-— . _=. ^ — ^ - — - - - - — j - - - — . - * ^ — - - 



' Over'stl Lfoal : Able to maintain sejf-control; pTqns and considers 
• < - • actions before carrying them out. ' • . ' ' N 

I. Sits quietly for rfiore than one'minute when*- * • 

group is attending to film; filmstrips:, verbal « * 

s , Instructions, etc, * . m v „ * 

*2. Takes turns in ac+lvfty 25% of time or less., ' " ' ^ 

. 3. Changes'/activity without emotional outbursts -'\ 

when change cue 'is well defjaed - (verba I / et«L* ) . . " 

4. Changes routine without emotional outbursts if , 
( when a Iternatlves' are presented.- l\ 1 



I '8 

j 

i 

> -J9. 
20, 



21 



22. 

5 2-3. 

24. 
25. 

.26. 



4 Acts according to social # r t ules In community and 
home activity situations. DIspTays^a mlh^mum^ 

■ of cryJng/ acting out and/or gloating. 

/ r • ' , * 

Avoids disruptive actions In public places. • \ 

'Controls tenjper ya \ I : verba I Izes'feel Ings IjxJ / 
*an acceptabfe manner, # /\ 

Accepts friendly teasing - smiles or laughs. 

• ' . ^ ^ ' 

Participates in actlvl tywithout Interfering - 
^with or disrupting others. 



Becognlzes own lack 'of setl f-control and works 
with others to improve sel«f. 

Plans/considers actions before carrying -it out. 

i ■ * r 
Maintains self-control when faced with failure, 
prob I ems , d i s ap^o I ntme nts . 

Able to maintajn self-control; plans and con- 
siders actions before carrying them put. 



\ 



\ 
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, Reproduced by permission of Horace W. Sawyer^ It Is requested that anyone 
using tfie System forward feedback to Dr.. Sawyer, Rehabilitation Institute ' 



Co-Uege of Human Resources, Southern ll-IInols Un1versl>7 at Carbondale, 



>>ondale, !L 62901. 



FUNCTIONAL LIFE SCALE (FLS) 



The . FLS" v»as deyelpped* by John E. Sarno, Martfia T. Sarno, and 
Eric Levita at" the. Institute of Rehab i I i tat ion Medicine of tfie 
New York University MkdicaJ Center in 1*973% 

'The FLS' is designetHfo provide a quahlitatj vq measure of an 
Fnditoidual's abilft»*1*o parti dpatej in basic .activities common 
to mpst people.* t^fo'cuses on functions actual ly performed 
r'atner than on« fh# capaci ty to perfona or the elements which 
cOpstitute performance. *' It can -'Be u$ed to assess disability, 
"jnctfonal limitations, and' to measure client change as a 
result- of participation in rehabilitation programs.' 

The FLS contain?. 44 items designed to assess five categories: 
'cognition,* acti viti^l D'f ^iaity living (ABL), a ct iv iti es in 
'the hoftife,. outside activities, .^and social i n f&v§&Tf^^ wh i ch 
includes vocational status. The four qdalit-ies of self-' 
initiation, frequency, <sp3ed,*and overall efficiency are rated 
for each item where* appropriate. For each of these qualities, 
each ,item \% rated alohg a 'five-point scale designee! as 
follows: 0, does 'nQt' perform activity at all; I, very poorly; 
2, deficient; 3, approaches normal; and 4, normal 0 

° ' v : ^ 

The FLS is designed 'for 'use With all disabled clients who are 
in* their hpmes' and *the community.. The ultimate concern is 
how the client functions in the real -world,. Therefore, it is 
Inappropriate tri ■artificial or limited settings, such as 
hospitals, rehab i Li tat ion faci I ities, etc^ 

The FLS is useful to, "both case managers and program*managers. 
It provides case managers an ^indication of the client's func- 
tioning and may be useful in -identifying problem areas and 
needed services.*^ The FLS provides program managers an indi- 
cation, of the severity of the disabi I ities*bf th.e^client pop- 
ulation which is useful in program planning. Change scores 
alert^program managers and case managers of the success or 
-fail r utf3 of the^i'r programs. Since inappropriate items can £>e' 
omitted, the f LexiUi I i ty of the FLS is increased. 

'The FLS jnav be useful, as an educational aid With 'physicians- 
in-training* It^may'also be useful in research designed to 
estimate the influences of specific physical, ^syGft&\cg\~ttt~, 
or social factors upon the rehabilitation process^ 

* * * * 

The FLS requires a ; combination of self-report and professional 
judgment, "Mr can t>e administered prionto, during, and/or 
fol lowlng^fhe rehabilitation .process. Raters must be trained 
to make accurate "judgments, .but it is not necessary that the 
raters % be.^physj cians* since medical judgment is not required. 
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Total scores for' each item are^alculated by surging fhe 
quality ratings.* for that itqm. it is the total scdre.for 
e#ch item that; is important because it defines what the client 
actually doea. , Si nee the same score can be achieved, for 
-various reasons, tptaf scores for the various qualities carl be 
used to determine the contribution of such factors as motiva- 
tion and spegd, " Scores for -a^gjven categ6ry (e.g., cognition, 
ADL, etc.). are taken as a proportion of- the possible maximum" < 
score, after adjustment for items that are not applicablei * 

Twenty-five patients were rated by II staff members. Each 
.patient interview was videotaped. Using the videotapes, each 
staff member in the' study rated each pat Kent twice, with an 
interval of^ two to three weeks between ratings. The following 
scores were statistical ly analyzed:' overall scores', total 
Stores for self-lni'tiatjon, .frequency, speed;.*and overall ef- 
' fluency. Test-retest. rel iabi I ity was' assessed through the-* 
Pearson product moment coefficient of correlation. The r 
values for eaeh'of'tfte raters far self-initiation scores, 
• 9(f; frequency 'scores, .90$ speed scores,' .90; cjveral I 
efficiency scores, .88*; and overall scores, .91, were al I 
significant beyond the .001' level-, estab I ish f<ng the ^stabi I ity 
of the ratings over time. * • . * 

To determine Interrater reliability the total scores oTall 
raters obtained for al I patients were'eompared and correlation 
coefficients derrved. Once again, all £ values were signif- 
icant beyond the .001. level. These results suggest that 
workers from a variety of di>scipl ines, with minimal indoctrl-' 
natjon, can use the FLS wittva satisfactory degree of agreement 
between raters and over time/ The £ values were as follows: * 
self-initiation scores, .90; frequency scores, .90;: speed 
scores, .88; overall efficiency scores, .88; ancf overalJ , • 
scores, *.9I . ; y ^ 

Internal* consistency was analyzed by means of a^ series of 
Pearson product moment correlations. These were derived 
'across all patients for each rater, across a"l I raters, and 
abross all category subscores and total scores. The same 
procedure was used to determine fhe degree of relationship 
between the quality scores as^ell as between total and sub- 
category scores (e.g., cognition, ADL, etc.). All of the 
coefficients of correlation reached significance 6eyond the 
.001 -level. ' ' - • ' - ; 

Concurrent validity of the^LS was estimated by comparing 
FLS ratings with' +he external and independent ^clinical 
Judgment" of a physiatHst, The physlatrlst ranked 31 
patients on a nine-point scale after completing clinical, 
examinations. Comparisons between .cl inica I evaluation aad 
FLS^ ratings using the Spearman rank.. order cor-c?+^tion yielded 
a value of .69, £< .001 on the basis pf a two-tai l#d test. 




'Advantages 



Limitations 



0 ' / 
References 



The results show a relatively high degree of congruence between 
ratings on the FLS and independent clinical estimates* by a ? ' 
physiatri st. 

A major advantage of the FLS is that It provi.des a quantita- 
tive measur;e~of a very nebulous but important clinical dimen- 
sibn. It focuses on actual functioning rather than on the ^ 
abilities to function* This approach avoids tfoe discrepancies 
often found between abi I ity and behavior, which are sometimes 
inf lueneejd by the -interactive* influence of physical, psycho- • 
logical, social, economic, and cultural' factors. 

The FLS .requi res further standard izatipfi and the derivation of 
^-jiorms on larger populations amd different types of disabled 

persons (i.e., those with Multiple/Sclerosis, Parkinson f s 
. Disease,, E[\Mepsy). 

Sarnc^ J. E./Sarno, M. T. , and Levita, E. The functional 
I ife- scale. Archives of Physical Medicine and Rehabi I i tation , 
1973, 54(3), 214-220. « , 



AvaN abi I ity . 



The FLS can be obtained from — 



John E. Sarno, M.D. , y 
.Institute of Rehabilitation Medicine 
400 East 34th Street V 
New York, NY 10016 
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THE FUNCTIONAL LIFE SCALE 



) 



m * 

COGNITION 

WWII 111 w 

/ 

I. Is oriented for time (e.g. hour, day, week) ' 


■+ 

QJ 

"O 
"O 

— \ 

o 

QJ 

CT 
CD 


— • Co 

3 CD 
- i— » — 

i 
o 


" Frequency 


Speed 


Overa II * f 
eff Iclency 


Total 


2. Uses "yes" and "no" appropriately 




* 










3. Understands^speech (e.g., simple coonmands, 
directions, television) \ 














4. Calculates change' (money) * 




— b 










< 

5. Does higher »ca leu 1 at ion (ba lance* checkbook, $tc) 














6. Uses approprfate^gestur^s in lieu of speech (not 
applicable for patients twith speech impairment) 








i ■ 






~ r 

7. Uses speeclv^for $Qmmunicatfon 














8.. Rea^sue.^^^+reef signs, abi 1 ity*« to„fol low 
wri+ten instructions', beboks) 










* 




1 » z 1 -! ' ; — 

9. Writes (e.g., signs name, writes pr types 
letters) (include motor disability) 


1 ♦ 


# 




> 






10* Social behavior is appropriate 






• 








II. Able to 'shift from one task to another with 
relative ease and speed | , f 














12. Aware eff self (e.g., of mistakes, inappropriate 
behavior,- po<?r judgment, etc.) j C 

i 




■ 










/ « 
13. Attempts to correct own errors (e.g.-, of judg- 
ments, mistakes) 














> ■ ■ 
14. Has .good memdry (e.g.*, names of people, recent 
events) • . A 














ACTIVITIES OF DAILY .LIVING 

15* Able to ge£ about (with or without brace, 
wheelchair, etc> 














16* Does transf|^^ , , m ' 


/ ♦ 








< 


4 



SERJC 



fl2 



IerIc 



I 

< 

* * *- . 

' — : * S 


Not appi icable 


Self- 
InltJatlon 


Frequency 


Speed 


Overa 1 1 
efficiency 


H 

O _ 
H-f 
. 0) 


1-7 ^ ^ ^ A ^ _ If « 

1.7 • Feeds self 














18. Uses foi let 














\9\ Grooms self (e.g~, wash, brush 'teeth, shave) 










r 




. 20. Dresses sel f 


• 








t 




0 

21. Bathes self (including getting in artd out 
of tub or stal 1 ) 




> 










'HOME ACTIVITIES 

22\ Prepares simple food or 'drink (e.g., snacks, 
1 ight breakfast) 














- * ; • : 

lb. Performs light housekeeping chores* (e;g.,- 

deal's, dishes, dusting) « 
« * 






A, 


« 






Z4. Performs heavy housekeeping chores (e.g., 
floor or window washing) 
1 — ! ~~ i — » 




- 






* 




25. Performs odd jobs in or around the/ house (e.g.; 
gardening, electrical, auto, mending, sewing) 




• 








; 


26. Engages in solo pleasure activities, te.g,, 
puzzles, painting, reading, stamps) ■ * 


■ 










/ 


27. Uses telephone (e.g., doling/ hand Tung. Do 

not rate speech proficiency.) 1 ' . 
tT* ' : ■ h 1 — * 






1 




• 




28. U^s telephone set (e.g., cfangi ng f ohann^l ) ' 








• 






29. Uses record player or tape recorder A ' 












1 


OUTSIDE ACTIVITIES 6 + f . 

30. Engages in simple pleasure actlv#ljffies 

(e.g., walk, c£r rides) ^^ rij ^ 




\ 

> K 

-» 








1 


31,, Goes shopping for food 1 

am 

— 














32. Does general shopping (e.g., clothes, gifts) 








* 






33. Performs errands (e.lj., post-office, cleaner, 
bank, pick up newspaper) ^ 






It 






* 

• 




1 

1 





/ 



1 

p 


Not 

appi Icable 


— CO 
3 G> 

Q) 
-+ 

O 


Frequency 


Speed 


(t>< O 

-h < 
-K © 
— 1 

O Q) 
CD — 

4 


Total 


34. Attends spectator events (e.g., theatre, 
concert, sports, movies) 




. % c 






—\ 

s 




35. Uses public transportation accompanied 
(mass transportation) 




i 


• 








36. Uses public transportation alone (rate NA 
if 35 is 0) 




• » 
f 










37. Takes longer? trips accompanied Cplane, 
, - 4 tra I n, boat, *car) ' 














38. Takes longer trips alone (rats NA if item ' 
37 is 0) 

/ • 














SOCIAL INTERACTION 

39. Participates in games with othej^ people -A 
(e.g., cards, chess, checkers) ^ 






• 








40. Participates in home social activities 
(e^g., family gathering, party, dance) 
*~~4 ' t ; ^ — 














41. Attends social ou net ions outside of home 

(e.g., home'of frfend^ dining at restaurant, 
dance) \ 


1 












1 * ; 

^2. Participates in organizational activities 
fe.g., rel igious, , union, service club, 
professional) 










> 




43. Goes to work or school at comparabfe pre— 
morbid level tnot housekeeping at home) * 
iuo not rate it item 44 is to be rated) 


t 






i 






IT* ~~ 

44. Goes to work or school at lower than pre- * 
** 'morbid leveJ (Do not rfcte if Item 43 has 
been rated ) (Multiply item 43 or 44 by 2) 

: — r ; * 















I' iReproduced by permission. Sarno, J. Sarno e M, T., and Levita, E. The Functional 
Life. Scale. Archives of Physical Medicine and Rehabilitation, May. 1973, 54. -(3), 
214-220. Scile developed a+ the Inatltute of Rehab 1 1 Itatf ofc Medicine, NewTork 



Jnl versify Medica'l Cerrter, *New York. 
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FUNCTIONAL SCREENING SCALE* 



Thts measure was developed by Sterling. I. Colten and Joseph* 
t^anglois of. the Taunton State Hospital in Taunton, Massa- 
chusetts, in 1974.' * 

The- Functional Screening Scale is designed to measure patient 
adjustment within a structured £nvi ronment. 

* *~ 
Patients are rated on 19 items in fiv§ categorVes: personal 
gfooming,- social interactions, work behgyior, self-respon- 
sibility, and verbal behavior. Ratings bp each item r^age J 
f rom* 0-3, y\ th the lowest (-atintjs ^assigned to patients display- 
Jng comp lete' dependence on staff supervision and the Jijcjhest / 
r-atJngs assigned to patients di sp fay irrgr^roependdncfe •'from 
staff supervision. \ J % s 

This measure was created for state hospital use to assist* ii 
deciding whfch individuals would be tf)e most likely cq^ndjdatg 
for community res>dences for ^the chronic population, 
measure was designed for u^e with the psychiatrical ly disabled. 
Most patients In the stutfy .were schizophrenics and some were, 
diagt^ospd mentally deficient, associated with psychosis or v 
some&form of organic brbin syndrome. • * 



~The administration of this scale requires the use of profes- 
sional judgment-^ the nursing staff. , ft can be compleiVd 
in' a f^wlpinutes, jAM nursing personnel involved with the 
individual should/rate him/her. * x ■ * 



A to"fel 'score can be obtained by p66ling r the scores an indi^ 
vidual fecei ves* f rdm al I qf the nursing personnel involved 
with tbfe. individual and then averaging tbe results. Hence* 
an indilvt-dual 's final rating woe Id be the mean perception/of 
all nursing staf f s ipvol ved./ The instrument is hand scored; 

The evidence for reliability stemmed from giving the same 
scale >o different'nursing shifts. The results were "not found 
to pB significantly different. Statistical fcvUdence, hov/ever, 
'not presented in the materials reviewed. - 



f 




A couple of validation studies wgfe- conducted. The first was 
th£ determination of correlation wiih another measure of adjust 
ment. The \MACC* Behavioral Adjustment Scale ? was selected *as the- 
cri'tericw instrument, as a number of reliability and *e1idity 
s/hrdfesr"] nvol ving the adjustment-of^psychiatric patients had 
beea done- on it .(Ellsworth * 1 97 J > * There was a correlation 
between scores on the two measures when they were both atlmini- 
stored to 110 chronio psychfatric p'atients^hy' four raters 
(£* .64, £ = .001). 
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Advantages 
•Limitati ons 

tefe recces 



Another validation study" examined the Functional Screening 
Scale as a discriminator between- we 1 1 -adjusted ar.2 poorly ad- 
justed patients in a hospital setting, 0n6 hundred £nd four - 
patients werp rated. Half had privilege cards, work, as'sign- 
njents, andwere housed on an open ward. The other .half had np ' 
special privileges, were housed on a locked ward, and were ' 
under continuous supervision. A significant difference 
(£= 35.47, 2, = •00}) Was foynd. between the rat frigs w ot-*he 
two groups, indicating higher functional adjustments for jHie 
privileged group.- Therefore, the scale does appear to measqre 
current, adjustment among chronic psychiatric patients. 

The scale i^s straightforward, easy to complete, and perceived 
as sensible by ward staff. * 

* v 

There is a lack of clarity in interpreting resul-ts 'that were 
crude Ly based on whqre an individuals scores fell between 1 
t£ie -means of well-adjusted and poorly adjusted pat ient< groups. 

_ * % . 
Colten/S. i. & J^ft§JoIs, 'J .\ Development of a screening 
scale- for proafammingpsychiatr'ic rehabi I i tat ion. Psycholo gical 
Report . 1975/37, 293-294. 



Ellsworth, R. B. The MACC 'behaviora I adjustment scale: Revised 
1971 n^nuaj. Los Angeles, ,CA: Western Psycho loqica I Services.- 
.1971. ■ • • 



AvajlabUity* This scale can be obtained, by contacting' — * 

^ 4 -Joseph Langlois 

Y FJr^nc^pa! Psychologist 
-New Bedford Area Facility- 
' , * Inpatient Unit Taunton State Hospital 

' P. 0. Box 151 

Taunton,, MA 0278(7 



\y 



roir 



/ 
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Patient's Name: 



FUNCTIONAL SCREENING SCALE' 



Nurnber of Admissions: 

Diagnosis: _| 

Education: 



i 



Age: 



Sex:. M or F 



Date pf Ifest Admission: 



Circle one 

Length of Hosp.( 

months 



(last grade completed) .Marital Status: S M Sep, Div« Wid« 

Please make your judgment on .each category according to the following standards: 

0. This is for patients who make no attempt to initiate and are completely 
unable to perform the activity as described in each category. They 
'require total assistance from staff, • .* 

L This is for palwfentS who make some attempt to initiate the activity as 
described by the t scale but require- supervision and "d-jrection from 
staff for the completion of the activity. 

2, This" is for patients who totally initiate the activity described and 
need-only minimal supervision from staff for the completion pf the 
activity. * . 

* 3. This is for patients who are totaj ly able to perform the, activity . 
described t5y the scale and need ho assistance from staff , 

Your judgments shou-ld be based on the long term patterns of behavior of the 
f>a*Hent rather than -o N n behavior seen recently which is related to pressures 
that will pass by. ♦ 



Personal Grooming 
To i let habits 



Socia I I nteraction 
Wi+h.-staff 



Showering and washing 

Dental Care 

AbMity to dress oneself 
Appropriateness of dress' 

Warcf Behavior * 

Assistance with ward .work 

Regard for ward rules 

Attendance at medication - 

Verbal Behavior ► 

Willingness to talk with another pefson 

What the patient says can. be clearly understood 



Wijh patient group 



With one other patient 
\ With family members 



J 



'Concern for safety of others 
Self-Care 

Eating behavior 

Sleeping habits 



AbMity to handle money" 

Concern for personal safety 



ERLC 



Remarks : Any immediate situation that may be affecting the patient's behavior? 
Medical problem? Psychiatric problem? Or other Issue of concern regarding the 
patient. ( * * • 

Rater* s Signature: . ; 

/ u 

Reproduced by pSfmlssiwi of Joseph l^iiglofs. 1 



•FUNCTIONAL STATUS JNDEX CFSI) 
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The FSJ_ was developed by the Pilot Geriatric Arthritis ' . 
Project (PGAP) staff, associated with the University' 
of Michigan Med ical\ School , Hospital, and School of ^ • 
Public Health, 'f rom \975-76. 

The FSJ_ was designed *t& measure the /client's percept * 
tion of functional stafUs along .three dimensions:' level . 
o^degendence, pain, and\ difficulty experienced while en-*; * 
gflgTng in 45 different adti'vi t,Ies of daily living (ADD • 
Repeated measures \:a*i provide an indication of change in 
functionaj status, .I.e. , decrease or increase independ- 
ence, pain, and/or cMf f icu-lVy . 

> » 
The FSI contains 45 items rated over three dimensions; 

therefore, as many -as l?5 specifjc pieces of data can be 
generated. 'Dependence is rated on a five-point scale, • 
while pain and difficulty are rated on four-point scales. 
The J terns were or ig ina I I y- categorized under three cate- 
gories: mobility, personal care, and work. ^Factor 
analysis identified five clusters of functional activities 
common to the three dimension^: gross mobility, home * 
chores, hand activity, personal c§re, end interpersonal. 

The FS] was designed to be used with ambulatory non-insti- 4 
tutionalized individuals experiencing degenerative arthritis 
or rheumatisjn, Modferafe changes were deemed necessary in 
adapting it for use with peopJe with end stage renal dis- 
ease ("weakness" was judged^jas preferable to "difficulty" 
with that groqp). ■ \ 

The FSL is intended for program planning and program eval- 
uation with non-i nst itutiona I i,zed ,cl ients with arthritis. 
At this time;, it seems to have limited utility in the 
state-federal rehabilitation agency. Should the instru- 
ment be found useful In evaluating Individuals experiencing 
other disabling cond-ifions and/or the j\me required to , ' 
administer it reduced., the FSJ_ would become an in- 
valuable tool in the state-federal rehab i 1 1 tat-ion sqff\n§/ 

A shorter, factored version of the FSI was developed from 
1978-1979. Three forms of response were studied: multiple 
choice, W7-poInt Q-sort, and a 12-point ladder scale. 
Moderate I iabi I ity was observed and some Concurrent validity 
established (Jette, 1979, 1980b). ' ' ^ 
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• The FSI was admiji istened via seTf-report v to >an interviewer;'^ 
client self-report questionnaires'might' be possible wi+h. 
some populations. ' During the PGAP Project, it was admin- 
istered repeatedly at three-month intervals. Some* trpih-: 
I ng "Is required to administer and interpret the instru- 
ment. Tfie FSI can be completed- jn one to one and a half 
hours using a trajned interviewer. It is anticipated that. 



a factored 'version .of thfe FSI wl J I be «e dm I'nistered in approx- 
imately twenty minutes, ... } * t 

Functional dependence *i s' assessed by asking clients- to des- - 
cribe the assistance required to perform each ADL over *" 
th^ previous two-week 'period. Scores are assigrved as. follows 
0 = independent, P = .uses mechanica I .assistance, , 2 = uses 
human assistance, 3 = uses both mechanical and human assist- 
ance, and 4 = cannot perform activity even withTmaximum 
assistance. Scores for", the decree of pairr or difficulty 
are;assigned on a four-poirft scale as follows*:' I = no pain/ 
dt'f f icu.lty, -2 = ,mi I d pa i rt/dif#icu I ty', 3 = moderate pain/ 
difficulty, and 4'= severe pain/difficulty* Overall scores 4 
*for dependence, prain, and tiifficirtty are the ayerage scores 
for a'l I relevant ADL.T^^Qurth score includes^an overall 
average called "status." m * ^< 

fnterobserver reliability of the original FSI -was assessed 
using nine interviewers and 19 clients. <j A tota'l of 55 
independent assessments were completed:' 6 \7 clients were 
assessed, by thre^^ndependent interviewers and .two clients 
were assessed by*wi> independent interviewers. All clients 
were assessed on the>same day to~eTiminate variations in 
the -f unctiona 1 status due to fluctuations in disease activi- 
ty. Yhe fol lowi ng ' statements highlighted the findings: '(I) 
Overall concordance for dependence ratings between inter- 
viewers us i fig the PGAP Il*fetrument is 85%. (2) ^Agreement 
ratios between interviewers for degree of diffi^pulty and 
pain in performing activities are lower than, thps§ in the 
dependence - d-imens ion. The highest degree of concordahce 
attained in any of the "mobility" category items for diff- 
iculty was 68^; three of the mobi I i ty items demonstrated J ess 
than ^a 50% concordance rate. Concordance for degree of diffi- 
culty on personal care items yielded a higher rate^of agree- 
ment with three items attaining v 90$ concordance or^more. (3) 
Reliability ratings of pain on function are intermediate be- 
tween dependence and difficulty. They range from .49 to .97. - 
(4) The data also suggest that as the degrees of difficulty,, 
pain, a/id dependence increase, the reliability of the ratings' 
decreases. This trend was observed w.fjth.each of the jfhree 
catSgorties of functional activities (i.e., personal care, 
work/ and mobi I ity items). 

Concurrent validity*of the FSl' was investigated by compa^wag* 
FSI scores'with the following measures of functionaj status: 
(Ifc. clients 1 overall rating of ^the condition of their joints; 
(•2) |l Pents*' overal I rating- of their ability to deal with 
their arthritis arid the probl'ems^it causes; (3) clientp' . . 

v I 
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report of the number of "good days" that they 'have had in 
% ^the. Ipst sevens (4) the client's service coordinator 1 ^ v 
. 1 ratTng'of the clie/it T s condition; (5) the coordinator's' 

rating of the client T s ability to deal with his/her' arthritis 
and related problems; and (6) two "objective" measures, 
\fliorn^ng stlffnes^and grip strength, 

A total of 213" concurrent assessments wer^e -ana lyzed; 95 
> clients participated at entry to the PGAP Program, 64 of 
thes* clients participated in the, three-month follow-up 
inl^vlew, and 54 participated in the' s ?x-month fol low-up. 
The most direct comparison- is the comparison between* the 
instrument scores and .clients 1 overall assessment of joint 
status, Tne direction and magnitude of the relationship 
ranges 'from ,24 to .48 at entry, three-month apd six- 
^ month fo I low-up/ interviews, and overa I I ; ,a I If-^orralatlons 
are significantly greater than z6ro (p< .05). 

In a second, comparison, there is a statistically significant 
correlation between each Instrument score and client assess- 
ment of ab4lity to deal with arthritis when a I (^observations 
are analyzed together. ^ While these two measures were not 
related at intalfe Into PtSAP, they^ showed a consistent pos- 
itive relationship at three- and six-month follow-ups. 

The third cojmprison mea sur e used was the clients* report of 
the number'^ol^'good day^wn the preceding week,- The degree 
# 'Of correlation between' theses iter lor* pnd 1;he Instrument 
scores* is 'positive and of moderate magnitude for 'difficulty, 
^ pain, and overall status. However, it is not statistically 
significant for dependencev ThelcorVelations yiel4ed were 
'•J4*, dependence; ,41, di f f icu Ity; * . 46, pain; and .40, overall 
status. The developers iee I that-thfs suggests that for 
older^people with Arthritis, pain and difficulty of function 
are more 'significant in their mir^s to a "good dayli-thaft-J-s — — 
independence of fuoction. 4 

The correlations between professional assessment <|f c I lent 
'_ joint statys, eind* instrument scores are low (rang! rig from . 
* ■ - j4 to h30) and only in thre£ of twenty cases* is^itie 
* relationship statistically significant. The observed - 
*v # correction between professional assessment of "ability to 

deal" and Instrument scores is«essentia I ly zero, as are 
^correlations between instrument scores and the "objective" 

measure^, * « 

« * • 

The Instrument measures ^ufrlque as^olcts* of the qualityiOf 
Mfe*of pecsons#ifh artlirltiia^/.e., level of* pain, and - 
difficulty) .as' wel I" as the more trad it! onai aspect of 
dependence. Also, the Instrument Is qdlte reliable when 
acimFnlstered -via Interviews with drained volunteers, 
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Limitations 



Preferences 



) 



professional interviewers, or clPnical personnel, and fhe ~ 4 
reliability may be further increased b/more specific in- 
structions to Interviewers. 

First, the instrument Is less rentable when used to score 
clients'wlth greater degrees of dependence, difficulty, or 
pain* Second, time required to administer the* instrument 
is prohibitive In m3ny settings. ftThird,- the exteni to 
whrch the FSi_ is useful asses^Lng the health of popu- 
lations with different crTroni^di^abl Ing conditions re- 
mains +o be tested. " ■ • 

Original FSI " * 

Deni'ston, 0. L. & 'Jette, A.'M. A functional status instru- 
ment: ' Validation fn an elderly popu I at ion. Hea Ith Services 
Research, Spring. 1980, 21-34. ' 1 



< 



Jette, A. M. An empirical approach ^evaluating functioricH 
capacity. Archives ofPhysioal Medicine and Rehabilitation , 
1980, 61 (2), 85-89. fa) — ~ " ~~ 



\ 



Avai labi I ity 



Jette, A. M. & Deniston, 0. L. I nterobserver reTfabil 
of a functional Status assessment instrument. . Journal 
Chronic Disease. 1980, 31, 573-580, 



ty 
of 



Factored FSI 
v 

Jette, A. M. 
chronic disea 
Medicine and ! 



Functional status index: Re I tebi I ity # of a 
$e evaluation instrument. Archives of Physicajl 
frehabi | itation. 1980 , 6I_ (9~, 395-401. (b) ' 



Jette, A. M. Quality^of subjective measures of the health 
of nbn- institutional ized adults with rheumatoid arthritis 
(Doctoral dissertation, University of Michigan, 1979). 
(University Microfilms No.* 79-25166). 

The original FS]_and information regarding Its validity and 
reliatxHIty are availably from 0. L. Deniston, wh.f le infor-. 
mation about fact<pr analysis-of the FSI_ and the factored fSl_ 
Is available ffom'A. M. Jette. Their addresses ^re follows: 



0. L. Deniston 
Associate Professor * 
Dept. of Health Planning.. 

and Administration " 
M4I42 School of Public 

Health II 
The University* of Mfefiigan 
Ann Arbor, Ml 48109 



Alan M/ Jette 
Dept; of Social Medicine 
, Hea Ith Planning • 
Harvard Medical School 
643 Huntington Avenue 
Boston, MA 021 1 5 
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FUNCTIONAL STATUS INDEX 



Code: Function 



0 - independent 

1^- uses, equipment only 

2 - human assistance only - 

3 - both equipment and 

human assistance 

4 - can not do 

5 - bed fast-% . s - 

8 - not asked,^ not answered 

9 - not appl icable 



Code: 



Difficulty and 
Ache/Pa i n 



0 
I 

2 
3 
4 
8 

9 
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* 

none 
mild- 
mod^ 
severe 
can not do 
not asked 
not . 

app I icable 




FUNCTION 



Walking 



i ns i de 



putside 



Staircl imbi nq 

stairs ' n ^ t ? home 
other stai rs 



curbs^ 



FUNCTION 



DIFFICULTY 



ACHE/PAIN 



CIRCLE WHICH EOUIP- 
MENT/ASS1 STANCE USED 



^Cane 
Walker - . 
Crutches 
Whee I cha i r 



/ 



Haadrai Is 



COMMENTS 



How far:' 
Yard only 
Few blocks 
More 



Transferring 



bed 



cha rr 



car 



tof let 



bath 



Bathi ng 



abf I fty to wash 
all areas 



turn faucets 
teeth care 



shaving 



Ha i r care 



comb i ng ^ 



washing 



setting 



v 



Bathes in: tub- 
shower-chair • 

Handrail - 
Non-sl ip surface 



r 



Toi let too 
low? Yes No* 



Dress i nq tnc I udi ng 



shoes & tying 



hose/pants 



underclothes 



shl rtV b^loiise * 



buttoning/zippers 



SERIC. 



sweater/coat 




Fasteners: 

Front 

Back 



122 
Code: 



Function' 



•0 - independent 
I'- use?* equipment only * 
2 - hurn^n assistance only 

both equipment an^ 

human 'assi stance 
* - tjan not do 

ted fast \ 

8 - not asked,, not answered 

9 - not Vppl i cable 



Code: Difficulty and 
Ache/Pa i 



0 

I 

2 
3 
4 
8 
9 



none 
mi Id • 
moderate 
severe 
can not < 
not aske< 
not , 
appl icab 



h : *- 

* 

. FUNCTION ' ' .* 


FUNCTION 


■i 

DIFFICULTY 


i 

ACHE/PAIN 


EQUIPMENT 
ASSISTANCE 
USED 


COMMENTS 


i*\\su i i i i y «c * 
ui i v 1 1 ly "<v ri lei 

transportation 




r — 


9 

K 




i 


shopping * - 








- • — » 

Commun Rations - 

ptK^ne. • 












'wr i t i ng « 








Emp J oyment/Occupat i orv - * 


\ 


— 






i 1 


Cooki nq v . 

stbve/ oyen/ ref r i gerator x 












i» ' SinK/TaUCeTS « * 








cupboards (high/'low> 


- 






i i tti ng poTS/pans „ * 




- 




npp 1 inn/^n++!nn * * 
pcci iiiy/uui r I ny 






-\ 


^ opening containers < 








f-hnQPP 1 P^nJ nn ^ 

IUUOvL 1 CO 1 1 I 1 * 

* * 

laundry * * ' 


» 


/ 


1 


\ 

#■ 

/ 
1 


♦ 

# 


sweeping/mopping 








bedmakfng.> * 


* 






dishes 








bathroom * * 






<* 


~ . windows , * 








Home/Yard maintenance 
. repa I r$ , 




X- 






• * 


yardwork; 








featinq/Fjeed^na 
,cut+l ng • _ • * 








* 


Eats: - 

Alone, 

With:' 


drinking x ' »' 
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" HUMAN SERVICE SCALE 

* 

Detfefoper(s) This scale was developed by Shlomo Kravetz, Kenneth W. Reagles, 
Alfred 3. Butler, and George N. Wright at the University of 
. Wisconsin Regional Rehabilitation Research Institute in 1973. 

Pucpose The Human Service Scale is designed to assess change experienced 

Jpy clients served through- i"he various human service agencies. 



\ 



Description The scale consists of 80 multiple-choice items which address 

f a client's statCis on 'seven scales, based on fclaslow's hierarchy 

of basic, human nee^ds: physiological need, emotlona I -security 
need, economic-security need, family need, social need, econ- 
v * , omlc self-esteem need, and vocational self-actualization need. 

1 It Is assumed that client progress Is based on the extent to 
which needs are. sa'tisf Jed In accordance with v Mas low's hierarchy. 
Items deal with self-activities, concerns, health,, and job. 
? \ Additlona I . demographic information is gathered as well for 

Identification and norming purposes. 
* • 
Use " This measure .can be used with a wide variety of clients In * 

various human service ^agency settings. It has been used in^ 
rehabilitations-agencies, VA hospitals, vocational education .„ 
program^, mental health clinics, social service agencies, land % 
» several research and development projects dealing with^ a loohol- 

ics, drug abusers, and delinquents. Certain client groupsNney 
have problems completing the measure without assistance (i.e., 
^clients who^are visually impaired, have severe motor^dPf f icul+les, 
or have probjerps reading at the fifth grade level). 
f ' & 

This measure is both diagnostic and evaluative in nature. As a 
sampling of a broad range of potential client problems in a 
number of life areas, it can be used diagnostica I ly by counselors 
and others involved in the rehabilitation process to identify 
problem areas and plan services more efficiently. It may be 
helpful In deciding who might. benefit from psycho log tea I , social, 
and other special evaluations, and It* provides a starting point 
, __ _ _ in th£ counsel I ng. process. As an eva l uation J"ooL the measure 

can be useful at the counselor level as a feedback mechanism. 
With even the subscale scores yielding sensitive measures df 
- - " client change, ft is* also promising as an outcome Criterion 

measure for program evaluators. It may be seen as, a measure o,f 
severity of the disability (i.e., more needs unmet^ more severity 
- more needed services). 

' « *• 

AdmJnlstritioa After spme brief instructions the client should be*able to com- 
plete the scale, which Is printed on a machf ne-scorable answer 
, sheet* It tsrkes about 25-30 mlnutes^for the typical client to 

complet^. A clerical person can be Instructed to complete the 
essential demographic data. The measure has been successfully < 
administered by ma I Fy but the nature «^ the client population 



would determine tfie feasibility of doing so. The Instrument 
should be administered as parf 6f a diagnostic evaluation, at 
closure (or annua My forMong-term clients), and at foliow-up 
(6-M2 months afr't'er services have beerwterminated) . 

Response choices for each*item are w^fghted to enhance the 
internal consistency of the measure. The weights were deter- 
mined by reel prbca I averaging. The scale is machine scored. 

Scoring services are* provided by the University of Wisconsin. 
(>§ee Availability section for address.) A computer profile 
of each client, ]b provided, along with a diagram with which 
the Client's status maybe presented graphically. 

The n9rms are continually updated. The normative group currently 
consists 6i several thousand human service cjients. Normative 
.profiles may be generated by any combination of demographic 
variables included on the first page of the machine-scorable form.' 

Based on a sample of 1,018 persons who had been accepted for 
rehabilitation services by state-federal VR agencies in 29 states, 
and the territory of Guam but who had not yet received services,*' 
Hoyt reliability produced J>y RAVE 1 analysis was found to be* .93 
on the tptal scale and ranged frpm .69 to .97 on the subscales. 
The reliability of the residual change scores, based on a group 
of 105 alcoholic qlients completing the scale at intake and again 
six to tehjnonths r later, was determined for each subscale with * 
results ranging form .55 to .97. 

Thirty-two rehabilitation counselors were asked to r^te the degree 
to which each o4 the original 150 items, from which the 80- item ; 
scale was taken, was r*elatefi t# each of Maslow f s five categories t , 
#of basic human needs, as defined by the scale developers. This 
•step' toward content validation produced an interrater coeffi- 
cient of ^concordance of .01. * j 

c urhher validation work was done by exaninfng the residual change 
scores^of different orouos (i.e., clients closed unsuccessfully,* . 
those stni receiving services, and those closed successfully 
rehab i I ftated) The* clients consisted of 105 a Icohol Ics- f n- . 
vol vedHn ^ rehabil H-atfon project who comp I eted ' the scale at£> 
Intake and again sIx4-o ten months fater (see Reliability sectfett 4 
above). Six of the eight* subSca les demonstrated significant 
change (o<= .05), Indicating that the measure is sensitive efiough 
to discriminate between those clients who successfully completed 
the VR process and those either sti II In-process or closed on^- 
.successfully rehabilitated. *o 

Thfs scale has an underlying theoretical rationale based on 
Mas low's basic needs { It expands the areas cov.ered to include 
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thqse not directly vocational in nature but important to' 
rehabilitation and influenced by VR nonetheless. 
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Jn addition to having" sMj>sc£le scores that are sensitive to 
client change/ it Is quick and easy to administer, requires 

m little In-service training of personnel, and is machine Scor- 

- able. ' ~ 

Because the data are based on client report, distortions may 
result. / * * * 



BacH.er\ P. T. Measurement of outcomes: A report from the study 
grotip on measurement of outc6m55r ----Ejx^^ on Rehab? If- 

tatlon Issues, .Denver, Colorado, April 15-17, 1974. Institute, 
West VTrginia: Research and Training Center, 1974. 

Growick, B.<S,, Butler, K. J., & Sather, W. Validation of the ~ 
human service scale as a program evaluation tool . Unpub 1 1 shed 
manuscript* . ^ 

Reagles, K. W., & Butler, A. Human service scale/ A new measure 
for evaluation. Journahof Rehabilitation, 1976, 42(3), 34-38-. 

# University of Wisconsin Rehab i I i tationOtesearch Institute. Back- 
ground information of the construction and validation of the 
. human service sea 1^ . Unpublished manuscript. T ^ 

Wright, 6. N. letter announcing Che availability of the human 
service sea le. 

The machlne-scprab la answer sheets (which include the actual 
scale itemsY and information on the computer scoring services 
thal^Fe avai lable* can be obtained from — ; v 

George N. Wright , 
University of Wisconsin 
1500 Highland Avenue 
Madison, Wi 53706 
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human' service scale ' * 

# 6. How often are you, uncertain, about decisions you mafke? 
(a) very often f (5) sojnetlmes 
(§) often * (I) hardly ever 

(5) as often as not . t • 4 

J 

' * v 

. 9. How often do you have trouble showing your feeMngs to your 
family? / 

(a) very often (5) sometimes 

(§) often 0 hardly ever 

(q) as often as^not 9 

10. How often are you bothered by shortness of breath when not 
\ exercising? 

(a) very often ^S) sometimes 

(§) often (e) hardly ever 

(c) as often asv Rot 

31. How often do you feel dizzy? 
G) vary often t (B) sometimes ■ . ^ 
(g) often (§) hardly ever 
V£/ as often as not 

32. Generally speaking, how often do you talk to your famJM^/ 
about what went on during the day? * 

(a) very often (5) ( sometimes 

(D^often — 0' hardly ever -* 

(5) as often as not 



f 
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43. Read the list of clubs and organizations to which people may belong. 

J I . any parent-teachers group * t 

2. church-connected groups (usher's club, -Ladles Aid, etc.), 
'3. fraternal lodge or auxiliary 

4. neighborhood clubs, community center (Including YWCA', YMCA) 

5. card clubs or social clflbs 

6. veteran's association * * 

7. service club (Rotary, Hons, etc.) 

^ 8. cfvlc organizations, (participation In charity drives, 1 
Reel Cross, etc.) 
9/ sports team 

10. participation )ti political activities, a political club 
o? pafty / 



43* (cont.) Hqw many, of the above, organizations do you take an 
, .Sctlve part In? 

@ none of them (S) 5 or 6 of them 

(i) I or 2 of them (e) 7 or .more of them 

(c) 3 or 4 of them 

56. How many weeks during the last six months were you unemployed? 
(A) none •/ ^ .(d) I ^-24 .weeks. 

(§)> 1-8 weeks (i) 24 or more weeks 

© 9-16 weeks * 1 

. i 

60. Which of the following statements bgst describes your present 
financial situation? 

(a) very good- v (5) poor 

(g) good * (I) very poor . / 
(5) average . 

I f employed - - . . 

* » * 

64* How of ten* does your present work let you make decisions on 

your own? t * 

(a) s very often (t)) sometimes 

,-(§) often (?)* hardly ever 

(5) as often as not 

* > *■ 

65* " How often does yoyr present work give you enough to da? 

(h) very often (o) sometimes 
0 often % 0 hardly' ever 
(c) as often as not % ■» 



. >.. ■ ' . 

Reproduced by permission. Copyright by the University of Wisconsin Regional 
Rehabilitation Research Institute. 
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INDEPENDENT LIVING CHECKLIST (ILBC) 
EXPERIMENTAL EDITION 



The ILBC was developed by Richard T. Walls, Thomas Zane, and 
John E. Thvedt at the West Vi rg!nia lv Rehabi I i tation Research 
and Training Center and copyrighted In 1979. 

The' HBCf provides a'measure of objective skills relevant to 
Independent Jfvfng'by defining the degree to which a client 
or trainee, using whatever adaptive devices required, can 
function without constant aid and/or supervision. 

The ILBC is a list of 345 independent living ski iV-objectlves 
specified in terms of conditions of performance, specific 
behavior, and standards of performance. /The objectives assess 
ski Ms in the following six categories: mobility skil ls, 
self-c?re*ski I Is, home maintenance and safety skills, food, % 
Skills, social fend communication skills, and functional' 
academic ski lis- 

The I1BC is useful for any client whose independent living 
skills need ^o'be identified and/or developed. Specific 
client groups might include mental Ly retarded, blind, quadra- / 
plegics, clients institutionalized for l,ong periods of time, 
severely disabled, 'etc. The ILBC can be used'in a variety of 
settings, such as sheltered workshops, rehabilitation facili- 
ties, educational /Training programs. 

The ILBC is^tuable to various professionals associated with 
the rehabilitation and/or training of independent \ iving clients. 
Counselors preparing Individualized Written Rehab i I i tat ion Plans 
( IWRP f s) 'will find" that N the ILBC provides a means of setting 
goals and evaluating the cjient f s progress. It defines inde- . 
pendent living sRfl Is clearly, specifies p broad range of 
skills applicable to a variety of necessary actLvifies of « 
dally living, and sets clear standards for mastery of skills. 
Program managers and program* evaluation specialists will "find * 
skill objectives specified' in terms=of conditions,- behavior, 
and standards permit documentation of client or trainee progress 
as wel 1^ as ^measure ojt the effectiveness of services and/or 
training. Additionally, tfie ILBC provides them a means of 
setting goals^ determining accountability, documenting legis- 
lative requirements, and outlining an objectively specified^ 
curriculum for independent living skills. Thd flexibility °f 
this instrument* Is heightened in that only skill objectives 
deemed relevant need to be used and-additlona I skill object- 
ives can be developed as needed. 

The ILBC Is equally valuable to otfier professionals. Teachers 
responsible for developing individualized Education Pjans 
(lEP^s) can use the ILBC tq set goals and evaluate progress. w * 



132 



• * . . ■ ^ * 129 

■■ " ' • / ; . 

Cottage or group home, parents/supervisors- w 1 1 \( find specif i- , 
cation <5f a broad range of adaptive skills applicable to a * 
wide variety of Jiving environments. Administrators of inde- 
pendent trajnlng programs will* find an objective means for ' • 
developing aqcountabl fity, cost effectiveness, staffing 
patterns, state plans, and funding applications^ 

The use of the ILBC requires professional judgment, but para- 
profess iona Is may ,easi ly be trained. The ILBC can be admini- 
stered as often as necessary to maintain an accurate view of- 
the c I ient r s competence. In some instances a single assess- 
ment of §klll objectives may be sufficient, but in other cases 
a periodic assessment of client or trainee skills Vs desirable. . 
Administration is achieved by observing the client; the time ^ 
necessary varies depending on the number of objectives deemed 

appropriate for the individual client. " ^ 

* » >^ ^ 

A Skill Summary Chart and a Ski I* Objective Prof i le are deve^fcped 
The Skill Surrcnary Chart H used as an overall record of at I the 
Skill objectives achieved by the client in. all six categories. 
The skil I S mastered by thejgWent in initial, assessment and in 
training, as well as the dajpthe skill was demonst rated or 
completed, are entered on the Skill Summary Chart. For any 
skill objective, mastered, ^M- n is entered. For any objective 
failed in initial assessment, a "-"Js entered. The d^te ^ 
training. was begun ,and the date training' was completed (the ' > 
skill was mastered) are recorded. The summary colunftn provides 
a concise view of the skill objectives mastered' in either 
initial assessment or training, and so summarizes the individual 
client f s progress to date in each skill category. 

The Skill Objective Profile allows foe a quick survey of over- 
all client progress in each of the six skill categories. The 
profile is constructed by dividing the number of skill objectives 
mastered in*a category by the total number of ski f I objectives' 
considered applicable to the client in that category, 
multiplied by 100. The instrument is hand scorable. 

The I LBC is considered in terms o*f reliability as stability 
and reliability as I nterobserver agreement. Reliability as 
stability was assessed using test-retest procedures" (two weeks 
between, tests). Two observers rated video presentations of 
five ; rehabilitation clients performing 'five randomly selected 
skill objectives from each of the six ski I I areas (I.e., 
mobitity^self-care, etc.). Stability acnoss six categories 
ranged from 96% to 100% using two observers. The overall 
mean stability of the ILBC was 98.056. An Index of interobserver 
reJ lability was computed by/ comparing the scores of. Observer I 
and Observer* 2 at Time I. Interobserver reliability across 
all six categories ranged from 96% to 100*. The overal I / 
I nterobserver *re I iab1 1 ity of the ILBC was .98/$ / 



The sklH objectives of this behavioral checklist are sarmples of 
situations. Content validity is an indication of hcWwell the 
skill objectives sample \he particular situation, i A., inde- 
pendent I iving ,ski I Is, Content validity does not yie\d a y 
numerical value but rather gives>a clear definition oftthe 
universe represented and descr;i bes -the procedure^£s+lt5wed in 
the sampling from that universe. Construct ion^ofthe I LBC < 
began with more than 200 behavioral checkl istsf col lected *f rom 
rehabilitation facilities and schools throughout tf]e United 
States and other" countries. * Of these checklists, 53 were * 
selected which contained items found to be constructed wall 
enough to suggest ways- to assess independent living behaviors. 
Thu£, the universe was based on the experience of many trai-ning* 
facility and independent living personnel spread over^a wida 
geographic area. Rather than samp I ihcf rom this broad array 
of behaviors, the' enti re universe was u?Jfcd to suggest skill 
objectives for mobility, self-care, home maintenance* and 
safety, food, social and communication, and functional academic 
skills. .While the I LBC fills apparent gaps In existing pleasures, 
the content of the I LBC captures the col lectlve experience and 
judgment of an impressive array of training personnel. ¥ It is 
more comprehensive than the wisdom and experience of a $ ingle 
facility, staff, or Training group. Thus, the content validity 
of the I LBC must be* considered high. * \ * 

Criterion-related validity was examined by determin-ing how 
closely the ski I Tobjectives of the I LBC conform to those behaviors 
that have been found necessary to actually live in an inde- • 
pendent setting. Both laboratory and field-based research * 
have contributed to the development of the Nebraska Assessment 
for Independent Living Skills (Schwab, 1979). Research and 
development of the Nebraska skills Involved W£5H^-rMlTemdt ion- 
ally disturbed short-term patients In state hospitals, a 
•bro^d range of Vocational rehabilitation clients in a fi§ld 
setting, and severely handicapped cerebral palsied clients. 
In each of these settings, the 'behaviors have been* narrowed 
and^ref.ined to yield the present set of skills relevant to 
Independent living. The behaviors Identified by the Nebraska 
group as, being crucial for IndependerfF living were examined 
by Walls, Zane, and Thvedt (1979) Iffter the skill objectives 
for the I LJ3C had been completed.* Thus, a. high degree of 
agreement between what has been found Important In contri- 
buting to Independence and tha ILBC Wild indica'te /ligh 
criterion-related validity. AN of the 17 categories defined 
by Schwab (1979) as-essehtlal for Independent living were 
found to be Included Jn the I LBC. The feriterlon-rel ated 
Validity with this extensively researched Nebraska source was 
1.0 (I00£).. The user: may have conf fdSnce, that the* I LBC ' v 
Includes the important and relevant skills foe Independent N 
living. 

The.sk! 1 Is to be assessed by the I LBC * can be a'djusted to suit.. . 
* • 
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the type of training and/or the individual needs of the client 
or trainee. This fs accomplished by selecting only those 
objectives which are relevant or writing additional objectives 
which are needed. V 

•Because skill objectives may-be a'dded, de.leted, and/or changed, 
'the 1LBC is simply a checklist of ski-lls-fa criterion-refer- 
enced measure); Jt is not ( a standardized instrument (norm 
referenced). 

Schwab, L. 0. The Nebraska assessment for independent living 
(Project .93- 1 03) el Lincoln, Nebraska: Department of Human 
Development and the Family, University of Nebraska, 1979. 

tyalls, R. T., Zane, T., and Thvedt, J.E. The independent 
living beh avior checklist (experimental, edition). Dunbar, 
WV: Research and Training Center Press, 1979. 



Copies of the ILBC and other pertinent nftormation is avail- 
able from — >- - 



Publications Department 

West Virginia Rehabilitation Research 

and Training Center 
One Dunbar P^pza, Suite E 
Dunbar, WV 250£4 




SAMPLE ITEMS 
I N DEPENDENT .LIVING BEHAV I OR" CHECKLIST 
Experimental Edition 



MOB1LITY / SKIUS - 
Up, Sta i rs 4 

"Condition: 

Behavior: 

t 

Standard: - 



stairs. v 
Weight Carry 27 



Given a flight of stairs of 5 steps or more with a handrail. 
'Client climbs or travels up the stairs. 

Behavior within I minute. Five step£ must be traveled up the 



Condition: 

Behavior: 

Standard: 



Given a bag of 'groceries (or a similar i/em) weighing 10 to 
1 5 pounds* | . m 

Clients picks jp* (from either 'a floor or counted? and carries 
the bag. ^ / ( 

J3ehavior within 3 minutes. A minimum distance of SGKfeet must 
be traveled without dropping the bag or items. 

SELF-CARE ^SKILLS ' . 

Dressi ng 2 * — , 

Condition: Given undgrwear, outer wear, socks, and shoes. 1 

Behavior: Client takes o-f and puts on clothes. 

^ Standard: Behavior within 30 minutes. All under and outer wear garments 
must be put on and -taken off correctly. No fastening, zipping, 
buttoning, of" + ytng is required. 

Shower or Bath * 35 ' * ^ 

Condition: G.iven a bathtub or slower prepared for bathing, spap, washcloth, 
ahcJ towe I . • 

Behavior:, Calient undresses, washes the entire body including soaping ^the 

- - 'body and shampooing the -hai r,__and then rinses and dries off- the . 

body. * t 

Standard: v Behavior within 30 minutes. No soap or water must remain on the 
bpdy^ andnq d ? rt must be visible. 



f 

Door Lock 2 s ** , 
f * 

Condition: Given a#key for the entrance to the home (e.g., house, apartment, 
trai ler).r ' ' ' * 

Behavior: Client locks .t*e door when leaving the apartment. 

Standard: Behavfor w.ithi~ 2 minutes. The key must be in the possession 

. of the client refore .the door is locked, and the door must be ^ , 
*^ focke\j so ithat it cannot be opened wrthout the key. -~ 

. 136 •:• . 



1 * < t . , ' • • -133 

FOOD SKILLS, . * . ' ' % n*#; ' % . ♦ , . ^ 

Frying Pan 43. *-••.«.. 1 ♦ . # ' 

s 

^CondHMon^ Given a frying pan on^a stove burner, or an electric frying 

pan .(plugged in,), and # food to be fried according to a specific 
recipe. * * * ^ 

Behavior: Client ±urna on the.burner or electric^f rying pan and fries' ^ 
.the food*- " ; % 

^Standard.: Behavior within the time specified by the recipe. - The cooking ^ 
- . * must foflow the recipe. 0 

SOCIAL AND COMMUNICATION SKILLS ' ^ 

Conversation *5 ' / 

Qopdition:. Given g role play or natural situation In which the* client 
' . converses with^otfters. ... 

* Behavior: Client initiates and participates in a conversation^ 

Standard:' ' In a role play or natyra I* situation, all persons interviewed^ 
<& ' 'must independently state that .the «c I lent started anti partici- 
pated' in a' conversation and did ndt remain, si lent. 

FUNCTIONAL ACADEM I C SKI LLS 

Cash Purchase 32 





^Condition: Given specific item(s) to be purchased at 4 a cash regisl 
(e.g,, food, clothes, movie ticket), and some money (no" 
checks or credit* cards) . 

behavior: CI ie^t^rchases '*fhe item(s). 

Standard: Behavior within 5 minutes. Sufficient cash rmi?t be paid 
tp buy all bf the items brought to the register, andsfhe 
correct change received. 




car 



/l37 ' 
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THE 1EVEL qF REHAB I LJ TAT I ON SCALE (LORS) * * 

Developer(s) The LORS was devehoped by Raymortd G. Carey of the Lutheran 
x * • General Hospital, in Park Ridge, 1 1 I Inofs,' and Em I I J. Posavac' 

* * of Loyola University of Qhicago, Jlllnois, in 1977/ ' 4 

. S < 

• Purpose The LQRS /is designed to provide a general assessment of patient 

functlbn/ng ,fof\the purpose of prognata evaj^ion rather than 
* for cluneal assessment.* It provides an assessment of overall 
functioning as ah Inp^tifent and as an' outjbati ent in order 
to evaluate patient progress after discharge from the hospital 
or health car^fac i I Ity. * / 

* <■ , 

Description The LORS contains five subscales whjch measure the following: - 

activities of daily living, or ADL (e.g., walking, grooming, 
transfer, etc.); cognition (e.g., speaking, reading, writing, 
etc.); home activities (e.g., cooking, housework, hobbies, 
i n , etc.); outside activities (6.g\, shopping, s^ect^toj^vents, 

' trips, ♦etc.); and social InteractIons(e.g. , part^fcTpating In 

games wdth others*, etc.). The scale contains 47 Items. _ * 

. / Us ® c^bg LORS Is designed to be used with *ai I clients in, a "physical 

mecMcine and rehabilitation unit. It seems more us'sfuf tp. 
physical medicine and rehabilitation unit personnel or 
rehabilitation facility personnel than to VR case managers* / 
or program managers* Inpatient rehabilitation teams have used 
the Information gathered from the LORS to monitor the.overall 
level of program success abd to satisfy the program evaluation a/ 
requirements of the Commission on Accreditation of Rehabilitation 
Faci I Ities^-- 

% . v . * 

*■» 

The LORS has been revised receqtffy (Carey^ & Posavac, 1 98 1 ) V The • 
new vers!pn, the LORS T J I , wpuld be useful to those Interested 
. * In assessing the progress of patients during their hospital 

* m . ' stays and for those Interested In using cost effective methods of 

meeting quality assurance requirements. The emphasis Is on 
areas.that can be Influenced by rrehablf Itatlon services, * 

Administration ^e LORS sfrould be administered" at admission (witnln three days 
] - . „ of admission), at discharge, and«agaln once the patient has had 

an opportunity to return home <and readjust to 'the home routine 
(generally about six weeks, after di sparge) . /jf x one chooses to^/ 
base ratings, on direct observations, experienced clinician's 
would be required (e.g.., physical therapists,' occupationa I 
v /\ therapists, physicians^ or nurses), However, clerical personnel 
;v m \ can b£ tftalned to Interview skilled clinicians and make the , : 

) „ gratings. \The same clerlca I personnel can conduct telephone 

1 ^ % ^Interviews with family members to conduct foliow-up* Interviews 

*l^once the patient, Is home. It is necessary that the interviewer 
Wk be thoroughly familiar wjth t|ie "scoring code guTde before < 

beginning Interviews. The guide 1$ not complicated but It Is, 

* * extensive and*canno1\ be referred to during the Interview, 

Administration of the LORS requires 10-20 minutes. ~ t 
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Each of ,tfre act! vlties 'making up the five major categories of 
the LOR& is ratafl on a scale from zero to four by a^trained 
Interviewer* * A'coding. manual is available which describes the 
numerical ratings In behavioral terms/ Because the activities 
In the Cognition subscale have" a I Iml ted .overt behavior 
component (e.g. Reading), the functional level ratings of 
cognitive abilities require more Judgment on the part of the 
Interviewer than the other subscales. 

Once * Individual ratings have been made, subscaje scores (e.g., 
ADL, Cognition; etc.) ai;e obtained by summing the Item ratings • 
for eggh sjubsca le and converting these jums Into percentages 
of normaXiunctiontng. When the spouse or nurse.has not had 
an'Opportunlty to observe a particular activity, the Inter- 
viewer makes no rating of that activity, and the oftission Is , 
not "held against" the patient; the score- Is adjusted for the 
unavailable ratings. A summary sheet accompanying the scale 
contains formulas to ^festet In converting sums .into percentages. 

In developing the LORS, ten interviews were conducted with ' 
^wo trained Interviewers present in order to examine the " 
interrater he! lability. One Interviewer made ratings based 
on the Informants answers but did not otherwise participate 
In the Interview. The correlations between the two interviewers 
for the ADL and Cognition subscales were .97 and .96, respectively 

Inter-Tnformant rerl lability wa^r assessed for 30 patients when 
both nurses and spouses were interviewed concern i ng 'the clients 1 
abilities at admission. The correlation between ratings based 
on the'nurse admission Interview and the spouse admission 
interview for AOL was .82. For Cognition It was .86, For 
another perspective on I nter-I nformarit rel i^bi I Ity, two nurses 
were Interviewed independently at discharge for 23 patients. 
For ADL, the discharge I nter-i nformant reliability was .95, * 
and far' Cognition It was .89. ^ 

The Internal 'consistency of each subscale was examined by 
calculating the homogeneity cbef f icient. This coefficient Is 
t^sed to determine whether the subscales of the' LORS are measured - 
of single variables or whether the subscales are^h^terogeneoas. 
Cronbach f s alpha w^s used with each administration of the LORS . 
The mean, alpha coefficient for ADL was .93; for/Cognl t ion, the 
mean alpha was .'88. The homogeneity coefficients were equi- 
valent 'whether they \e^oe tcu tated &\ the basis of nurse ratings 
or spouse ratings. The v regaining three subsca les were only/ 
administered to the spouse aftd were shorter than ADL and 
Cognition. The alpha coefficients were ,8fyfor Homtf^Acti vitles, 
.76 for 'Outs I He Activities, aad .64 for Social Interactions. . , - 

The LORS possesses, good* Interrater f^ellabi Mty gnd inter- informant 
reliability. The homogeneity fpr^pL and^ogni tfon yas also 
excellent. The lower hanogene^mT'coef f Fcierits for Home Activities 
Oiits.Ide Activities, and So.cISt^lnteractioos should be evaluated 
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against the* purpose of the LORS. If the* LORS ]4 i>sed>o 
estfmate the overall functioning of a group for program 
evaluation purposes, these subscales possess adequate homo- 
geneity/ These three scales', however, are not of suffitientV 
purity -to usq confidently as^'assessment instruments for indl- 
vidua I npatients. - * / 

Convergent and discriminant validity were constructed to 
determjnte if the ADL and Cognition- subscales are distinct 
from onewhother. Ratings on'the^e two subscales were avall^* 
able from both a nurse and a spousd\for 30 patients, i If 
ADL and Cognation are distinct abilities, then correlations 
of the ratings of ADL and Cognition should be lower than 
the Tnter- informan t reliability of bOTh ADL and Cognition. 
1 ntef-i nformanT correlation* 
(.86^ exceed the .correlate 
fon both nurses (.59J and sf 



;6fvA0L~ (T82T arrd Cogni t I on 
\between ADL and Cognition 
fuses (.50). 



Criterion validity was constructed to determine If the subscales 0 
ref lect -known differences among clients. Although based on a 
small* sample, subscales, did jdi^scrimi nate between left and right 
hemiplegic CVA patients as * expected. Left ffemiplegTc CVA ■ 
patient^^xpaetj^ce perceptual .difficulties while right hemiplegic 
patients suffer greater speeclj diff ictfltiW. The subscales 
correctly detect t^ese differences in that Cognition scores 
are higher for l,eft hernial egW CVA patients bctfh at admi: f 
and at discharge; ifowever, right hemiplegic CVA patiep*< 
prove more on ADk^since they are Jess burdened by pgscep 
problems. .jf * • p 

* * 

RS include the following: 
uL hi provi di ng a 




Qf aSVaifta^es o'f using the 
"datively inexpensive," it* is 



Some 

It i.s/reianveiy inexpensive, it is u 

qu^dxitative^assessm^ht* of functioning for "both inpatients and 
Outpatients, and, ffa Is behauJora I ly anchoj*6d 'and useful 
documenting improvements resulting from medical care. 



in 



The 
and 



LOfts 



^ is intended tp provi die a global measure of functioning 
not to' be a jcI Inlclanr's tool. Also, a few I tents on the 
Cbgnition and A0L subscales are concerned with areas that 
canhot be changed by rehabi J itation services. Those Items have, 
besn omlttefj ^frorn the LORS- 1 1 (mentioned in the* Use section) 
In order to focus more ci^arfy on areas over which 'rehabi I itation 
services Tiave an. influence. * . • 



Carey, R; G^,'& Posavac, 

scale - 41 : ( LORS- II): A comprehensive and cost-efficient method 
of evaluating rehabi I itation programs * Manuscript* pending 7" 
publication, 1981. 

: Garey,, R. 6., '& PosevaC, E. J. Manua f .for, the level 
't^tior* scale F,n Functional Limitations: A State «of 



V 



E. J. T&e I eye I of rehabi I itation 



of rehabi 1 1- 
the Art* 



Review. Fplfs Church, Virginia: Indices, Inc., I978r 

i .*•*. , ^ 

Carey, > R., 6., .4 Posavac, E. ?J. Rr-ogf£m evaluation of a physical 
nfedJAIrte and j;ehabf UtatJon unit: A new approach. Archives of 
Phvs-tcal' tfedl cine and Rehab U Itation . 1978, 59, 330-337. 



The LORS, along with the gianual, scoring codes, rating sheets, 
and scoring* aids, Is available from — 

Raymond G. Carey, Ph.D. 
Di rector t 
Health Care Evaluation Division ■ * 
Parks I de Medical Services Corp. 
f 1580 N. Northwest* Hwy. 

Park Ridge, IL 60068 ^ 

Information on the LORS- 1 1 can also be obtained from the above 
source. ^ - ' 
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LEVEL OF REHAB.IL I TAT I ON SCALE 
RATING SHEET 

it 

- ■ Informant 



Name of ^patient | ; . 

Interview: - * - 

I. Admission 2. Di^cf^rge" 3. *6-week. fol low-i{0 4. 4£-month follow-up 

Date: , = 

Note: *When Informant d oes not know patient's ability, en±ac "?" 
and treat as NA in scoring 

ACTIVITIES OF DAILY LIVING (ADD * 



s 



o 

£RIC 



* Able to get about 4 ( v 




2. Abi 1 ity to walk V 




3. Speed of walking 




'4. Does bed and chair transfers 




3. Overall efficiency of feeding self 




6. Speed of feeding se'lf 




' 5 — ' ' - 

7. 1 ndependence/f n using toilet 




8. Bowel and bladder control 




r ' ^ ■■ ^ ' 

. 9. Grooms self ( 




10. Speed In grooming self 

: * : 




IL Independence in dressing self ■■ * 




«t * / ■ - 
12. Speed In* dressing selff ' ■« - 




13. Independence in- bathing 

-2 ♦ ■ : 




14. Speed In. bathing 




COGNITION - _ ' 

|5>- Is oriented \for time (e.g., the hcTur, day, month) 




16. Understands speech such a$ simple directions 




17. Uses "Yes" and "Mo ff appropriately 




* * * 

( 

* i * 



• < 
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18. Qua I ity of speech 



M9. Speed of sp.eech 




20. Use of gesture^ In place of speech (NA for patients wl'tHout speech 
Impairment) . 



21 . Reads 



22. Writes 



23. Can make change for money 



f 

^^^jt^JJoes^fflore- comply checkbook. Income tax forms) 



25. Initiation and appropriateness of §ocial behavior (eye contact, 
. sm 1 1 es ) 



26. Abie to shift from one task to another with relative ease and speed 
(Patient does not repeat letters when writing, can move through the 
steps of grooming self without help "rn stopping a step and moving 
on to the next step) 



27. 



Can monitor own behavior (aware of own mfetakes in speech, realizes 
some behaviors would be inappropriate) 



28. Ability to correct errors (as in #27) 



29. 



Recent memory (0 = less than 10 minutes; 4=10 minutes- or more) 



HOME ACTIVITIES 

30. Prepares simple foods and drinks (juice, toast, coffee) 



31. Performs I ight housekeepio& chores (meals, dishes, dusting) 



32. Performs heavy housekeeping chores (floor, window washing) 



33.^ Performs odd jobs m or around the house (gardening, minor repays, 
mending, sewing) 



34. Engages in individual pasttimes (reading, knitting, collecting) 



35. Manipulates telephone and/or television (dialing, changing stations 
do not rate speech Impairment 



OUTS I 
36. 



DE ACTiVmES ~Z7 • ^ 

Wants to engage in simple outside activities (walk£, 'rides) 



37. Does shppping and other errand? (food, clothe?, banking) 



38. Attends spectator events (theater, concerts, movies, sports) 



r 



j 



.ERIC 



143 



140 



* y 
Jj* U 1 1 CI 1 Ijpvl Id 1 1 VII CJ LfVIIIJJ Si M v^J \ UU 1 Uj UUU^ II U 1 11^ |J 1 a uc / 




40. Uses transportation Independently (Rate NA if #39 was 0) 




41* Takes longer trips (5 hours) accompanied 




42. Takes longer trips independently (RageNA if #41 was 0) 




SOCIAL INTERACTION 

43. Participates in games (cards, checkers) with others (Do not 

ra+p c ie \ 1 I } ' 
1 a IC DM 1 • i y ^ 




A ■ 

44. Participates in home social activities (family visits, friends) 




45. Attends social functions outside of home (friends' homes, eat out) 




46. Goes to church or synagogue 




47. Goes to- work or school „ • ' 





*4 
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LONGITUDINAL, FUNCTIONAL ASSESSMENT S.YSTEM (LFAS) 

Oevelcper(s) The LFAS was deveiopec. by The Institute for Rehab i I *• Tot \ on and 

, Research, Behavioral Ecology Proaram, Houston, Texas, and copy- 

righted in 1981. ' . 

•Purpose The .LFAS will provide continual measurements of actual patient, 

activity over time, 

* » ^ 

Description • The LFAS is composed.of four components, (i) The Self-ubserva- 
tion and Report Technique (SORT) is the primary date col lection 
method used to gather information about the daily activities 

* of selected target individuals. The SORT Is an interview 

f technique ttfat can be used in a variety of data c ollection modes. 

The interview carT be conducted by the I nrerviewer "vtcnttre" 
telephone or face-to-face with the client. In essence, the SORT 
interview is a technique to quantify a person f s daify activities 
during a^ certain period of time, usually 24 hours. The inter- 
¥ * * yiewer records the client ! s reported sequence of behaviors. 

To help clients reconstruct their activities, *The interviewer 
must be able to provide prompts to stimulate and enhance ,the 
clients' recall. As the activities are reported, the inter- 
viewer translates the activities^into uniVs of behavior. When 
completed, the interview produces a quantitative record of 
what the person did, when, with whom, where, and some informa- 
- tion on how* the activities were carried out. 

(2) There are two mechanical or electro-mechanical devices ^ 
employed in the LFAS to provide measurements of specific 
• r • behavioral parameters. The wheelchair odometer is a small, 

unobtrusive mechanical counter. When attached to the wheels 
of a ^wheelchair, periodic readings of the center produce 
* a measure of the linear distance traversed during a period 

of time. The number of feet traversed during' a week, for 
example, is an excellent measure of mobility. The RTM/STM 
/ ' is a srtell device which records elapsed time electrically. 

When connected to pressure sensitive pads and placed beneath 
' * either the* mattress of a bed *or a wheeJchair cushion, tjje 

* , RTM/STM device provides a measure of time out of bed (Re^t ^ 

* Time Monitor - RTM) or ^ime sitting in 9 wheelchair (Sit Time i 
'* 'v 4 Monitor - STM). . * 

s (3) The Environmental Negotiability Survey (ENS) provides a 

- sens IffvdV abjective, quantitative approach to assessing 
flying environments for the* physical ly disabled. The dafa 
prbduced by ttre ENS can «be usefl to counsel clients on home 
modifications on a cost-benefit basis. 

;(4) The Longitudinal Data Management System (LDMS) \i a 
9 package of computer programs designed to greatly facilitate. 

management and analysis of LFAS data. Although designed- to 
< * support the data produced b> extensive use of the SORT, the 
* LtiMS Is very flexible and. can be applied to /many data manage- 

ment problems/ 

; - ' as ■ : * 
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The focus of the system is on the pat!ent ! s performance under 
everyday circumstances, "both within^the hospital- and following 
discharge, * Measurements of the .patiWt* s performance are made 
arfQ include the location, tinte, as^stance from^ others, 
sociability, diversity and number of specific behaviors, and 
rate of change in these behaviors over time, Tfre LFAS is focused 
on measures of actual client behaviqr. 

» 

The LFAS has been developed, tested? and refined in the context 
of comprehensive rehabilitation for spinal cord injuries, and 
thus Is most appropriate when uspd in similar contexts. J 
However, the SORT and supporting computer-based data management 
system is very flexibfe and can be Bsed for many purposes with 
many di f ferent popul ations In both institutional or hospital 
settings as well as with clients at home or'in the community. 

The LFAS should be useful to various rehabilitation professionals 
(e.g., case managers, program managers, physicians, occupational 
and physical therapists, social workers, and others). Case 
♦managers may find it useful in. determining eligibility, developing 
Vehabi I itation^ p lans, an3 assessing cl ient progress. Program 
managers may f'ind it useful in documenting the impact of their 
prog:rams. In addition, the LFAS should be useful for a number 
of research and program evaluation purposes. 

The LpfB^ s designed for individual ^assessment over long 
periods of time' (up to years). However, the LFAS .can be used 
to reflect the functioning of systems (wards or units, programs, 
services, etc.). The LFAS Is most powerful when employed to 
provide* measures of patient/client outcome. That is, the LFAS ' 

provides measures of dependent or criteria yariables. 

* « * * 

t * » 

The LFAS measurement t<3ols can be uSed by rehabilitation team 
•members (nurses, therapists, case managers , *-«+c. ), by profess- 
ional performance monitors, or by* researchers. The time 
required for use varies With the extensj veness of application. 
Generally, less thaiT two person hours per patient interview are 
^required to collect, p'rocess, and Interpret the data from the 
SORT* • " . ' 

There Is no scoring In the traditional sense jassoclated with the 
questionnaire Instruments. Each measurement fbbl In the LFA 
System (SORT* Odometer, RTM/STM, ENS) produces data that can 
be easily hand tallied to reveal peViMnep*^iqdlcators. 
"(I) SORT* For use with spinal cord ^^ured^opulatiohs, key in- 
dicators of status and progress carf be tal I leoS^I reef ly from the 
Interviews. ' When the SORT is employed* with the LDMS, a wide 
array ^ behavior status Indicators cjn be developed. The 
programs Include the capability of developing norms for any 
s^^of Indicators for any population*. 

(2) Odometer. The cumulative counter Is reatf periodically 
(e.g., dally, weekly). The cbunts on the cdunfer represent 
ttheel revolutions. * A simple cohvel:stofi translates counts Into 
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Mnear distance (e.g., feet, Hteters). The'meSsure of mobility 
is the distance traversed per time period (/days, weeks). 

(3) RTM/STM. The measurements produced of hours sitting or 
hours out of bed can be used directly for assessment of status 
and progress. It is useful to average dafly data into weekly 
means. / * 

(4) ENS. Scoring of the ENS fnvo I ves !\ itt le more than calcu-^ 
lating percentages. The data produced can be used directly 

for assessments of I iving arrangemefjjs or for counseling for 
environmental modification. * / 

The developer reports high levefs / of reliability and accuracy 
for each of the LFAS- components^ 

The developer reports that the LFAS has documented validity 
in the following areas. There are no inferred under lyj^g^* 1 * 
constructs; face validity is high. The key indicators of 
functioning for spinal cord injury are internaUy consistent. 
The measures of client status are useful ^o clinical teams 
conducting programs of comprehens Lye- rehab i I i+atlon. The key 
indicators of functioning for spinal cord injuries have extremely 
high predictive validity. ? 

Some of the advantages include the following: ' (I) LFAS can* 
be used to provide retative4^continuous monitoring rather 
than periodic assessment; C2l CPAS is based on Observable 
patient behavior as -it occurs, rather than global* Estimates, 
retrospective judgment, o=r professional opinion; (3) the 
indicators of cMeftf functioning are objective and' quantified;; 
(4) the LFAS wilt reveal outcomes or results that were not anti- 
cipated or are unexpegjed; (5) the orientation of the LFAS 
is to monitor direct I y whatever clients do in their everyday 
routine and then translate this actual behavior rnto quantitative* 
assessment of performance rather than basing ft .on prior, *^ !t 1* 
p re-selected categories of behavior. - - 

Some of the limitations include the following: (I J The* LFAS 
i£ designed for longitudinal application. Although it can be 
used In a polnt-In-time fash!on/*It has limited application - 
as an initial status evaluation .or screening device. (2) Jhe 
primary data col lection, tool (the*SORT) requires use with 
clients of average Intel Mgence and verbal commun ication ski 1 1 s. 
(3> The ENS req'ulfes'a home visit with the client present. 
(4) The rationale and. techniques of the LFAS are unconventional* 
~A J thought simple and easy to understand, most rehati I i tatfon 
professionals are urrfamillar with this approach. 

Alexander, J» L. 4 WMIems, E, P. Quality of life: Some * 
measurement 'requirements* Archives of Physical Medicine and 
Rehabilitation. 1981, 62, 261-265. ' 



Will ems / E;Pi > ^iBehavioral ecology, health status, ^nd healthy 
care: Applications to the rehabilitation setting, 'In I . Altman 
and F. Wohl wll I (Eds. >, Human behavi <3r and environment . 
New York: Plenum, I 976< * 

m 

Willems, E.,R. & Alexander, J,. L. Behavioral Indicators of * 
client progress after spinal cord injury: An ecological 
contextual approach, "In T. Mi I Ion, C. J. Green, & R. B. Meagher, 
<Eds.), Handbook^of health care cl inical psychology . New York: 
Plenum, In press. 

A list of additional references can be obtained from Dr. J* L. 
Alexander (see Avaf I ability section for address). 

Mater I aJs- and additional information can be obtained by con- 
tacting the appropri ate office at — „ 

The institute for Rehabilitation and 

Research (T-IRR) 
1333 Mour£und Avenue • 
Houston, TX 77030 

A training package for the SORT Is available through the 
Division of Education, TIRR. ' For 'some purposes, additional 
technical assistance may be required. 



The LDMS^bmputer package is available through the Division of 
Educatiori, TIRR. Technical assistance, for installation and , 
initial familiarization with the programs may be required. 



A train Wig package for the ENS Is being developed and should 
be available through the*DIvis!on of Education, TIRR, sometime 
In 19821* _ • 

The wheelchair odometer an^RTM/STM instruments can be obtained 
from the RehabFI I tation^-EfJglneerlng Center, TIRR. Contact .either 
Dr. L. S. Ha I stead~oT~Dr/ T. A. Krouskop at"TI RR V . / 

Additional Information or Inquiries shoU4*d*be directed to 
-Dr. J.* L* Alexander fn Behavioral^ EoDlogy (G-238), TIRRv 



J 
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THE 'PULSES -PROFILE 
GRANGER AOAPTAT 1 01 



0 



Developer(s) The PULSES** Prof i I e is. a -vernation of the Pu I hems-Jrof i J e 



X. 



Purpose 



Description 





developied by the Canadian Army and later adapted by the U.S. 
Army. Moskowltz and McCann .changed the specifications of the 
PULSES Prof 1 le and included additional .items.to make it more 
appl^&able to the aged and the chronically ill In 1957. 
Carl Granger made additional modifications in the mid I970 f s. 

The PULSES Prof i le reflects a client's Independence In life 
functioning and hence is qn indicator of the severity of a 
cl ient 1 s-disabi I ity. * - ' • 



The PULSES Profile contains six items which are scaled from 
one to four, representing the client*^ need for assistance 
In performing different activities, "bne" indicates indepen- 




* tfence Trom the help of others, whiT^"fmir n Indlcatrr^omplgt"^ - - 

dependence. Each letter in the acronym, PULSES, represents one 

of the six different areas to be investigated. The areas are as 

foi lows: ' ' 

♦ » " • 

p - physical condition; 

U - upper limb functions, including self-care activitifes^ 
L- fower limb functions, including mobility; 

S - sensory components relating to communication 
/ and vision; 

cretory functions; 

Situational factors, including Intellectual 
and emotional adaptability, support from the 
family Junlt, and financial ab I I ity. . . 

The PULSES Profile was* orlglna I ly intended to assess individuals 
In a restricted environment with limited physical requirements. 
It needs to be supplemented with other assessments for use in 
the rehabilitation process -- • rehabilitation agencies and faclli- 
ties obtaining information about the_severlty of ^the disability \ 
and especially with the mentally retarded and emotionally - 
disabled. r ¥ 

The PULSES Prof i le is useiul to both case managers and program 
managers. It provides the .case manager witb a crude iadlcator of 
what the client can do and what problems he/she might experience. 
.It is b&uaticfal to program managers and case managers in planning \ 
and del I verlng services, In describing individual and group 
progress in rehab! I Itartiort and Irt evaluating treatment effective- 
ness. I fr could also be useful in population surveys conducted to ' ; 
determine levels 'of disability^ 
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Administration 



Scori ng 



Rel iabi I ity 



Administration of th#. PULSES Profile requires training but 
little professional judgment. It is genera I iy .comp leted, 
after reviewing c I ient , records, including all pertinent 
medical and social data, and interviewing the client. The 
numerical values given the various categories constitute the 
tfasls of interpretation; therefore, counselors and other ' ' 
-paramedical persctfineT are rel ieved of the difficult task, 
of interpreting medical data, lt*can be administered in a 
few minutes* • t 

» 

The scale can be administered at various points, Assess- 
ments at admission, discharge, and follow-up carj^indicate 
. the effectiveness and efficiency of services. Assessment at 
the time of client transfer to another agency or facility can 
provide patient functional status information. % 

THfe rating^ of I to 4 in each area preside a profile of the 
cl ient^s functioning in each area. A 'total score is calcu- 
• lated by summing the area ratings. TqtaL scores range from 
.•6* to 24. The higher the scor§, the more dependen+vfhe parson. 
Studies have suggested useful operational cutting points for 
distinguishing varying degrees of severity in a disability} 
^further study needs to be done in* this arei. The scale- can 
be hand scored in- a matter of minutes." 

Three hundred 'seven severely disabled adults, former patients 
at 10 comprehensive medical rehabilitation centers, were sub- 
jects in a study, injrhich the PULSES Prof i le was administered. 
Test-retest reliability was .87 and intercoder reliability 
was above .95. 



Validity 



Advantages 
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Two hundred sixty-nine patients who were admitted to an acute 
stroj^ayjjfit Were discharged home, to a rehabilitation unit, or b" 
to a Ton g -term care, faci I ity. Discriminant function analysis 
indicated that the PULSES and Barthel Index (a measure of a 
client's independence in mobility, self-care, and bladder and 
bowel control) discharge scores 'were the strongest predictors 
of discharge outcome- from a number-of factors. Also, the 
PULSES and BarthVf Index scores ^at discharge correlated -.9 
/they are scored 4n opposite directions). 

Similar ^sults wer e obtained with 'Information gathered on 45 
patients who had been transferred from- a stroke unit to a v 
rehabilitation unit. Df scVirnlnant. funct ion analysis indicated 
that the PULSES and Barthel Index rehabilitation discharge scores^ 
along with the rehabilitation discharge level of intellectual ^ 
and epotion^ I- adaptabl I ity, made statistical ly* significant ' 
contributions to tbe equation predfcting discharge outcome. 



>The PULSES* Profile is brief and *asy tp use. " It is, a valuable - 
tobl for rehabi I Itatlon* practitioners as. long as it'is usecJ *\ 
as a brief profile of the cl i'e^t' s .abJ I Ity rather than "as a 
measure of detailed evaluation. 
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y T The PULSES Prof Tfe* i s»ariented toward the physical ly disabled. 
Clients who are - totally Dlind or totally deaf or Tnenta I ly [re- 
tarded would be con,£ijfered ml I d to moderately disabled if there, 
were no other comp I jJKlons. However, the .Rehabi I itation Act 
of 9 1*973 indicat§4fd^P al I of these are severe disabilities. 
,Next, It I s r posmfijgpto b'e classified as* severely di sab led If 
a score of 5 (jpTnor abnormality) Is assigned'for eaob item 
(t^tal score otI2), yet a person who Is totally dependent in 

r\Jtwa reas- and totally independent in all others can receive 
the same score. Therefore^ the medical conditions and the 
environmental conditions mus^ always be understood fn context 
withfthe functional scoral/This should avoid problems, in r 1 

\ adoption of +he qcal^t^^tate agencies on a widespread basis 
to deterttotlne eligibility. Finally, the method focuses on the ' 
client's actual funcfnonlng rather ftt&n abMity to cope^with 
the condition; therefore, the system- does assess the diet's 
r % progress when the assessment is repeated over time. 

granger Adaptation 

Granger, C.V., Albrecht, G. I.*, & Hamilton, B, B. Outcome of 
/ comprehensive medical rehabilitation: Measurement by PULSES 
P profile and\the Barthel inde£. Archives o f Physical Medicine 
and* Rehabi I i tat ion , ftpr! I' \ Wf, '\60£ 145-IW. — — 

Granger, C. V., Sherwood, C. C, & Greer, D. S. Functional 
states measures in fc a .comprehensive stroke Q:are program." 

7 Archives of Physical Medicine and Rehabi I i tat ion, December . 

• I977, N 58, 555-56J. ' • * * 



- Moskowltz and McCann -Adaptation v « * \ 

Indices, Iner Functional limitations: A state-of-the-art * 
review . Falls (^hurch, Virginia: Author, 19^8. 

* *** 
Moskowitz, E. & McCann, C. B. Classification of disability 

in the chronically ijl and agf^g. Journal of Chronic Disease. 

1957, 5 (3), 342-346; " '* 

9 Urban Institute* First year report <5n section 130 demonst'ra- t 
tren projects . Washington, DC; Author, I~976. 

'Additional information can be obtained from — 



Carl V. Granger, MD, Director 
Brown Unlverslty/The Memorial Hospital 
Institute for Rehablfi tation and- 

Restorat I ve -Qare * * 
Fami ly Care Center 
89 Pond Street 

Pawtucket, Rl . 0'J860 v 

4 

or ' ** * 

Maure&n McNamara, Coordinator 
Medical Rehabi I ftation Evaluation 
ftami ly Care Center , I 

89 Pond Street 
Pawtucket,- Rl 028^0 
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. WJLSES PROFILE \ ' • . ^ ' 

, ' m ' - ( GRANGER ADAPTATION \"'"* 

- Physical condition: includes diseases of the viscera (cardiovascular, 
gastrointestinal, urologic, and endocrine) and neurologic disorders: 

1. Medical' problems sufficiently stable that medical or nursing - s 
monitoring.. Is not^required more often^fhan 3-month Intervals. . r 

2. MejJ+e^[ or nurse monitoring Is needed more often than 3-month 
* Intervals but not each week* * . - ' 

*3. Medical problems are sufficiently unstable as to require regular - * 

medXcal and/or nursing attention at least weekly. 
4.^ MfedlcaJ problerps require Intensive medical and/or nursing extent I on 
. aty^aslvdally (excluding perspnal care assistance ooly)* 

• Upper I imb* functus: Self-care activities (drink/fe^d, dress upper/lower, 
brace/prothepis, g room /wash,' per I nea I car*e) dependent* ma I ri I y upon upper * 
I imb iunctjon: . - 

I." I'r^lepenqent in se I f-car$ without Impairment gf upper l,Imbs. 

• 2. Independent in self -care with some impairment 9 of upper Mmbs.r / 

3. Dependent upon assistance or supervision In self-care wltfci or 
without impairment of upper limbs. 

4. Dependent totally In self-care with marked Impairment of upper * 
limbs. Y # 

• Lower limb functions: Mobility (transfer pha I r/ioi let/tub or shower, 
walk, stairs, wheelchair) dependent mainly upon lower limb function: * 
I'. Independent In mobility without Impairment of lower limbs. * 

*2. independent in' mobi 1 1 ty with some impairment In lowep limbs; such - 
as -needing ambulatory aids, a brate or prosthesis, or else fdlly 
h independent in a wheelchair without significant architectural or 
f environmental barriers. 

. Dependent upon assistance or supervision in mobility with or withouf 
impairment of lower' limbs, or partly Independent in a VheeJ chair, or 1 
there are significant architectural or environmenta I* barriers. * 
4I„ Dependent total ly In mobf 1 1 ty"flith marked Impairment of lower limbs. 



Sensory components: Relating to communication (speech and hearing)-and 
'Vision: ^ • • 

1. Independent In communication and vision without Impairment. _ - 

2. Independent In communication and vision with some impairment such 
as»mild dysatphr^fa, mild aphasia, or need for eyeglasses or hearing 
aid, or needing regular eye medi carton.' " 

3. Dependent upon assistance, an interpreter, or supervision in 
commun feat ton or vjhslon. t > 

4. ^ Dependent^ total ly fn communication or vision. * 



\ 
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E - Excretory functions: . (bladder. and bowel): 



1/ 
2. 



3. 



4. 



Complete voluntary control of bladder and bowel sphincters; 
Control of sphincters allows no.rmal socia I activities despitfe 
urgency , or nsed for catheter, appliance, .suppositories, etc, 
"Able to* care for rteeds without assistance* 
Dependent upon assJ stance in sphincter management or else has 
accidents^pccasional ly. 

Frequent wetting or soiling from incontinence of bladder of 
bowe I sp K i peters * 4 



S - Support factors: Consider intellectual and emotional adaptability, 
support from family unit, and financial ability: 



I • 

2\ 

3. 



4. 



Able to fulfill uswal roles and perform customary tasks. 
Must make some mocflf ication in usual roles and performance of 
customary tasks. 4\ • ^ S** 

''Dependent upon assistances-supervision^ encouragement or 
assistance^ from a public or private agency due to any of the - 
aboVe considerations* 

Dependent Upon long-term institutional care (chronic hospitalization, 
-.nursing, home, etc.) excluding time-limited hospital for specific- 
evaluation, treatment, or active rehabilitation. 



Do 



'•^^^fteproduced by permission of Carl V. Granqer. . 
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. * REHABILITATION INDICATORS ("R I » s 

Devefoper(sV The flehabl I Itat ion indicators are being dQvSloped by 

* Leonard J31 I ler, Wllbert Fordyce, Durand Jacobs, and , 
Margaret Brown for the Rehabt Jttatton Indicators Project 
, at the'New Yprk University Medical Center. , 

Purpose ^ * Rl r s wlj I be used to assess and describe- diverse aspects 

of client functioning. s ' 

Description Rl f s consist of four assessment instruments Status 

^ I nd^^ors^ Activity Pattern Indicators, Skill Indicators, ' * 
and tny+TCnmenta I Indicators) whtcfi are designed to Capture 
characteristics and information about client functioning ' 
across various l"If e* areas- f rom four points of view. Each * * 
of the four instruments can be used Individual ly^or ?n com- 
. * ^ binatlon witfi the others.^ The Rl f s are descriptive state- 
ments present^ In- "non-jargon" language and they refer to 
k specif Ic, observable aspects of behavior and environment. 

^Each descriptor may* act as an indicators-rehabilitation 
'progress, depending on the individual or^group assessed and 
on the rehabilitation setting In which/the assessment occurs. 
Agr Indicated belov(, the four sets of 'descriptors differ In 
the aspects of functioning investigated and In approaches to 
data gathering. ' * * 

- ' (I) Status Indicators consist of approximately 50 descriptors 

in six areas of f unct'i<&i ng: vocation, income, education 
sehf-care (including housing arrangements afnckass istance " 
■ provided), transportation, and family role. Status In- 
jJ "* dlcators may look like "demographics," but they Include 

only'those variables that can be influenced by disability 
and by rehabilitation efforts. Status' Indicators are ^ 
recorded in an Inventory format' by Interviewing the gllent 
' ' -or significant other, or by. investigating already existing 

records. . . 

4 

(2) Activity Pattern Indicators , (API ? s)»are a family of 

Instruments that are. designed to desorlbe an Individual f s 
✓ 1 ■ patterns of daily activity: types of activities en- , 
gaged In, location, ,use of assistances and levej of con- 
' . current social GG'tyfact. Two«baslc approaches to gather- 
ing such data have been developed: (a) An 1 nventorV of 
activities, In which a standard list Is used to review, 
the nature of activities engaged in during a specified 
^ v time sampFe (e.g., "last week," unless atypical for 

the person). The Inventory Is administered either through 
k \ /interview or self-admlnlstered questionnaire. An op- 

tional activity. diary can be filled out daily by the 
individual -prior to the I nventory f s *b^i ng administered, 
(b) A Time I Ine format Is also SVal lable in which through. 

. , . ■ . i. 

' r . . . • ,• ... 
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erWew an Individual reconstitutes two recent typical 
days^ from. memory or on the basis' of an optional diary. 1 
Data-gathering time with either format varies with the 
number of optional activity dimensions being. coded and 
the complexity of* the Individual's pattern of activity; 
typically claims on the d^ta gatherer's time vary from 
five minutes (with the Self-Administered Inventory) to 
50 or SO minutes .(with a timeline tn+ervleto In which the, 
informant has not kept a diary and where all optional 
activity dimensions are coded), 

(3) Skill Indicators contain 711 specific skills which -provide 
a 'description of the "behavior tools" a person has or has 
problem^, with In meeting his/her vocational, educational, 
recreatlona I , faml ly role/ self-care, and other goals. 
The ski I Is are organized Into more than 70 ski I I packets, 
and users pre-select only those packets relevant to their 
target atidlencrf and only the relevant skills within each 
packet. The Skill Indicators assess tasks that are 

.\ meaningful units, (e.g,, "turns knob tp open door"). Tjiey 
"dp not assess partial tasks or movements, such as rotating 
forearm, nor do thqy assess feelings or thoughts. Ski H 
Indicators are recbrded in a problem list format by ob- * 
Irving or interviewing the client or significant* other, 

(4) Environmental Indicators are presently being developed and 
describe aspects of the client's physical, social/ and * 

* f personal environment that support or hinder the attainment 

of rehabilitation goals, w ; 

Use « Rl 's focus largely on fiyictfoning per se, r^t on impaired 

¥ f iflnctioniog or functioning that compensates for an impairment 

(e.g., Jibing sign language). Therefore, R]_ descriptors can be 
used In assessing able-bodied persons as well as persons 
4 with a ny- type of disability (e.g., physical, psychiatric, 
sensory^ and/or developmental ). • The developers of Rl 's 
recommend thel.r use In nearly all rehabilitation settings 
(e.g., state-federal VR, rehabilitation facilities, medical 
. / j rehabilitation, independent living centers, etc.) as well as 

non-rehab I Mtattpp settings (e*g, mental health centers and 
hospitals).- *' ' - 

i RJ_ descriptors are designed to be used^by a number of rehab- 

<** Ilitation professionals (e,g,, program manager*, »nurses, * *' 

psychologists, physicians, aides, occupational therapists^ 
( etc). Using RJ_ descriptors, program managers Vill— ^e able 
to document client change, thereby enhancing the *f ^ce validity 
of evaluation data; better monitor and^supervlse counselors; 
) * 'and Identify the usefulness of specific Inputs in CQntrlbutlng 

to client outcomes antong 'specif lc> cl tent groups. The generic 
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language of ' the descriptors will afd case managers in 
determining eligibility; Identifying client needs^-speclf ying 
goals, measuring multidimensional outcomes, and assessing 
goal attainment. .Another feature of the RT f s flexibility is 
the convenience of, using' only those forms and items selected 
as appropriate to the individual client and/or specific pro- 
gram. In addition, the use of the RlMescr Iptors should 
prove helpful in facilitating internetting and Inter- 
professional cornrntfhlcatfon and in providing information for 
program eva I Uators/ researchers, and policymakers. 

BJ data can be ascertained in a variety of ways (e.g., 
professional or para^rof ess iona I observation, selfnreport 
vla^ Interview and/or self-administered questionnaires, ' S 
/interviews v/Ith the client's significant other(s) or relevant 
rehabilitation personnel). Rl data can be obtaineji at any 
point in the rehabilitation process, or subsequent to It, The 
Rl project staff plays £ significant role in recommending to re- 
habilitation settings how best to gather RJ_ data'to meet the 
needs of r the particular setting. The negotiation process be- 
tween RJj asers : artd' the R£ project staff f is* designed to develop 
a modified package pf descriptors whloh—^al though uniquely 
Applicable to its setting, uses rtodules that are* comparable 
^across settings. In- the future, training packages will re- 
place the need for such intense RJ_ staff participation in planni 

Status Indicators generate categor'ical^escriptive data that 
are not scored as s^ch. Status, data can, nevertheless, be 
used to describe individualized categorical change (e.g., 
change In employment status, greater access to transportation). 

Activity Pattern lndicators T scoring 'depends upon which data- 
gathering format is adopted and which dimensions Of activity- 
have been^d^ded. Th£ standard form of data reduction, how- 
ever, consists of measures of the Individual's level of par- 
ticipation within activity categories (e.g., vocational, 
active recreation^ travel). Measures depend on the form- 
used: ThQ Inventory ^generates two measures, frequency and 
diversity, whlie.the Time I lire generates an additional measure; 
percent duration. Levels of participation dan also be gen- 
erated to describe where an Individual engages in the activity' 
(La** home vs. away/, use of assistance during activities - ' 
and/or the presence of other people .during activities. Thus, 
API data are descriptive of an individual's participation In 
home and community settings. ^ Y 
* • 

Ski 1 1 Indicators are simply scored:, 'A ratfo. for each skill 
packet- Incorporated Into the assessment Is generated to in- * 
dicate the^umber of skills viewed as being problems or as 
beincj null compared to the total number of skM Is In the 
packet. Scoring' is used to summarize the skill descriptors, 
but typically users place greater emphasis on Individual ski I'! 
Change than on the summarized data. 
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Rl descriptors are -designed for (ndlvtdua I . assessment-; data 
can be summarized for Individuals or across Individuals to 
provide group data. 

Reliability * Reliability Is continually being explored to a wide variety 
of contexts during field testing to determl ne -trai nine? pro- ' 
cedures to optimize the reliability of data gathering. Test- 
retest reliability of an earlier form of the Inventory, for 
example, was determined using samples^'of 'individuals to pro- 
vide activity data relevant to two typical contiguous weeks. 
With N72O, 10 of 12 categories of activity by type were 
1 significantly correlated over the tw6 weeks T data sets. Thes6 

* data were usetT^ubsequentky to* Improve the, format and proced- 

ures of this Instrument. More exhaustive studies are pres- 
. . ently being conducted relevant to the Timeline form of API f s 
and to the Ski 1 1 Indicators. 1 

Validity , ; Validity is being explored by correlating R£data with dis- 
ability i nformation, demographics, psychological test scores, 
and other functional measures. For example, when paraplegic 
4 * - r and quadri^Jeglc groups were compared, s the former had sig- 

nificantly more diverse patterns of activity, traveled more, 
and spent more time In' family role actlv.ity (e.g., paying 
bills, shopping)*; females engaged in more social activites 
thaa males; greater diversity of activity was associated with 
•* * lower values on'a measure of depression. Results of studies 
of Rl r s and other measures that reflect on validity have 
been and will ccfntjnue to be published." 

Advantages R£ descriptors provide the following advantages: '(I) Thefr 

organizing characteristic^ and variety of uses make them 
» flexible enough to be used In a wide selection of evaluation 

approaches. (2)" They allow multTdlmensiona I and observable 6 
outcomes to replace unidimensiona J definitions of program 
success . Program evaluation can focus on an appropriate I y 
wide or narrow range of functioning to reflect fully the 
rehabj>fta^ion agency f s areas of accountability - from 
"vo^tlonaf only" to independent *>fvfng ff to even more 

^adl'y focused areas. (3) Their structure and organization 
♦ y ' allow for ea£e of data reduction'as appropriate; Information 

can be obtained ^t relatively gross'levels and/or at Relatively 
specific levels with data collapsed to appropriate levels as 
prbgram.evaluatlqn needs dictate. (4) They provide a Ian- 
. guage of functional assessment with broad app I icabi 1 1 ty, .with 
the potential for use between various subsystems of rehab- 
• ✓ , 1 1 Itatlon* (e.g., VR, Developmental Disabilities, Independent 

*» * Living, Medical Rehabilitation, etc.) and varlng sets of par- 

, tlclpants (e.g., client-counselor, supervisor-counselor, etc.). 
(5) Their dissemination through the I debt I f IcatlcSn of specific 
packagds of descriptors relevant'to particular settings will 
provTde I ndlvl due relets of descriptors based ort the needs of 
the user while generating data which can be pooled for broader 
analysis. 

■ - .. .. + ' r 
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Limitations- The variety of applications of Rl ! s within rehabilitation 
have not yet been as^ful ly t^ s+e 4 as + he developers would 
^-llke, limiting the degree to which they can be freely dls* ' 
. * *semlnated. « 

References Brown, M., Dlller, L. , Fordyce, W., Jacobs, D., & Gordon, W. 

» Rehabilitation- Indicators: Thelrjjaiure and use for assess- 
ments in B. Bolton and D.W. Cook (Eds.), Rehabi I ftatlon 
cl ient assessment * Baltimore: University Park Press, 1980;; 

* ? 

Rehabilitation I nd Icators Project. Rehabilitation Indicators: 
An overview of the Rl project . New York: Author. 

• . Rehabilitation I nd Icators Project. Rehabilitation indicators 4 

. update, Numbers 1-5. 

Availability The Rl y s are not yet being generally dlssemi nated. All mea- 
sures except the Environmental Indicators have been fully 
developed and are being field teste'4- All will be more 
freely disseminated in the coming months; foMowi ng* completion 
of training guidelines. Those interested In obtaining additional 
, information on the development of the RMS or project publica- 
tions and/or results of field tests should contact - — 

Ms. Margaret Brown 
Project Coordinator 
Rehabilitation Indicators Project 
% . ' '400- East 34th Street 

New York, NY 10016 
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REHABILITATION INDICATORS 



Status 
S4 



Indicators 



Housing Arrangement: 

P| S4.M Epter one code for type of 

< dwelling; If code is greater 
than ,! 2 !! , complete and skip 
to S4.2. 



] S4.I2 For codes "0-2 ,! in S4.ll, 
enter number of rooms 



S6.I Pub I ic Transportation Status: 
For each type, enter one code. 

Q S6. 1 I 'Taxi service 

□ S6 



□ S6. 
*Q S6. 



12* Transportation for disabled 
(i.e., specia I 1/ hired, 
accessible vehicle) 

13 Bus service 

14 Train/subway 



S4. I I Codes: Types of Dwe 1 1 i ngs 

0 House * v \ 

1 Apartment r 1 

2 Hotel room* or suite 

3 Half-way house, short-term placement 

4 Hos.tel, long-term group living 

5 Institution, private or' semi- 
private room . 

6 Institution, more than four persons 
in a room 

7 Intermediate care nursing home 

8 Skilled nursing*home 

9 Other housl ng » 



S6.I Codes: Level of Use 

0 Used frequently (once*a week or more 
♦often) 

1 Used occasionally (less th'an odce a week) 

2 Not used, but available 

3 Not used, not available # _ 



7T 



- Activity Pattern Indicators: Self-Administered Inventory 
6. How many ti/nes ' ' ' If ,! 0 ,f In week, how * 

' in the V/eek... did you do this Housework activity? 'many times in the Month ? 

Cook or prepare meals (like make 'breakfast, make t 

coffee, set* the table)? 

' Do dishes (includes clear the table, load dish- 

" washer, dry dishes, put them away)? 

* Clean house (Includes vacuum, dust, wash windows, . 

make or change beds)? 



9 
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Do laundry or iron clothes? 
Sew or repair clothing?. 

Do small repairs or routine maintenance chor^ 
^around the house (like replace. a light bulb or 
fix a dripping faucet) 1 v. 

. '"■ '153 
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How many times j 

In the Week... did you do this Hou»6ftbrk activity? 



) 



• * If "0" I n week, how 
many times lr> the Month? 



Do yardwork or gardening?*-*^ 
Work on or wash a car? 

Do other housework ahd home maintenance activities 
not mentioned above (like water houseplants, put 
away groceries)? 

Specify 



\5f_ If you participated in any rehabilitation activities during the week In 
question, 1 1st them here and Indicate how many times you did them, 

(Rehabilitation activities Include psychotherapy sessions; training In 
activities for dally living and for using prosthetics or orthotics; coun- 
seling; medial rehabilitation; speech, occupational or physical therapy 
sessions; day actfvlty programs; psycho-social skills training; work 
' adjustment; and training or work evaluation programs,) 



How many times , If ,f 0" in week, how 

In the Week... did you*part!cIpate i n , Rehabl I Itatjon many times In the Month? 

activities? (Describe) ^ 



Reproduced by .permission. Copyright (c) 1981 by L. DIMer, W. Fordyce, D. Jacobs* and 
M. Brown. Rehabi I Itaf Ion Indicators Project, NYU Medical Center, 400 E. 34th St., 
New York, NY 10016. All rights reserved. 
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MEASURES' OF CLIENT PERCEPTIONS 
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MINNESOTA IMPORTANCE QUESTIONNAIRE (MIQ) 



The MJ^ was developed by Evan G. Gay, David J . Weiss, Darwl n 
D. KendeJ^ Rene V. Dawis,* and Lloyd H. Cb^quj/t at the Univ- 
ersity of Minnesota. It was copyrighted 1 nT97 I and revised 
In 1975. V • / • 

The MIQ Is deilgped to assess vocational neieds and to predict 
job satisfaction for an Individual. 

Two forms of the MIQ are available: a palrfed from and a ranked 
form. The two forms are equivalent. . The' MIQ paired form con- 
tains 210 Items wh l-ch address tfte Individual's preference* for 
relnforcers In the Ideal Job. The first 190 Items of'the paired 
form are presented In a pal r-comparMson fojgoat In which each of ^ 

20 vocationally relevant need dlmensldns are compared with every 
other need dimension. The final 20 items require the Individual , 
to decide whether each need dimension Is Important or unimport- 
ant to him/her. Thus, the client makes troth absolute and rela-v 
tlve judgements of the Importance of vaclous needs. " * j 

The MIQ rank order form consists of 126 Items. The first 105 
Items are presented In blocks of flv£ Items. Wlthi/i each of the 

21 blocks ttie Individual Is $sked to rank the relative Importance 
of the five need statements from I to 5. The-f-i-nal, 21 items 
require the Individual to Indicate the absolute level of Intport- 
ance of each of the need statements. The rank order format 
requires the addition of a 21st need dimension. ^ ^ 

The MIQ Investigates the importance of 20 (or In the case of the 
ranked form, 21) vocationally relevant need dimensions that have 
been found to be Important to job satisfaction: ability utili- 
zation, achievement, activity, advancement, authority, company' 
policies and practices, compensation, co-workers, creativity, 
Independence, moral values, recognition, responsibility, 'security, 
soda I service, socl a I status", superv I s Ion-human relations, 
supervl,sJon~technfca I, variety, and working cond it-ions (the 
ranked form also Includes autonomy). 

The MIQ Is appropriate W vocational rehabl I Itatlon cl lerits, 
employees, and stujiejtf's* Dt would be useful In any setting In 
which vocational y^lannl ng vfould occur (e.g., state-federal VRS, 
rehabilitation facl I Itles, educational/training facilities, etc.). 

The MIQ Is used In the following w^ys: (I) It cati be used to . 
prepare for counsel I hg. Characteristics of the client that are 
Identified (e.g., high scores In activity, Independence, and 
variety) might sugges't that the client will be Tmpatient and 
want Immediate action.* (2) The flIQ can be used to' assess the 
impact of a disability. This is feasible If a pre-dlsabM, 
work history Is available and the evidence Indicates 
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adjustment for these I lent prion to the onset of the disability. 
Pre-disabI I Ity needs might be Inferred from Occupational Reln- 
^ * N forcer Patterns^(ORP ? s) of satisfying Jobs 'previously he>d by 

X the client. Comparison of pre-* and post-dl sabll I ty needs might 

provide Insighf Into the impact^of disability. Thus., a client ■ 
might appear to be less achievement-oriented or more security- 
, conscious, after becoming disabled. Such fnstghts *are useful 
\ ^ not only in vocational planning but also In thfeimanagement of 

the rehabl I Itatfon process for the client. (3) The M1Q may be 
used In conjunction with a taxonomy of work, the Minnesota 
Occupational Classification System II (MOCS-II), In carder to 
Identify a broader set of occupations appropriate for the client 
In terms of neeti-rel nforcer correspondence 'and ability-ability 
requirement correspondence. MOCS-II presents ability requirement 
and reinforcer system Information* for over MOO occupations. 
Occupations are grouped Into families having simi laT rei nforcer 

^ characteristics and ability requirements. MOCS-II Is keyed to 
Occupational Reinforcer Cluster (ORC) and ORP occupdt ion corres- 
pondence scores erf the MIQ, as we I I as to Dictionary o.f Occu- 
pational Titles and Occupational Aptitude* Pattern codes. (4) 
Need scales of the MIQ can serve to structure Information-seek- 
ing by the client. .. MIQ scales identify reinforcers m£5t salient' 

* for the* satisfaction of the* I ndi vidua I ; knowledge of these can 
help to focus £cquisition of occupational Information upon the 
most relevant occupational characteristics „ for the individual^. 
(5) The MIQ might also be used y to. help a client, especially one 
severely disabled, plan the effective use o"f his/her non-work 
time. When the nature of a cheat's disability limits the choice 
-> of ..possible Jobs, available jobs are usually not as satifying 
to"+he Individual. In such, a case, careful choice of non-work 
activities can compensate for the'lack of need satisfaction In 
work. ' * * 

Administration The Ml$ is a self-report instrument, and its completion requires 
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at J east a fifth-grade reading ability. Items are presented in 
a reusable booklet, and the Individual records his/her respqn- 
ses on a separate answer sheet. It is generally administered 
prior to counseling. The tLme required to administer the MIQ 
paired form averages about 35 minutes. ^Average administration 
time for the MIQ ranked form Is about 20 minutes. 

Scoring Hand scoring Is possible', but the complexity of the scoring 

process makes' It Impractical. .Computer scoring Pfe available . 
through Vocational Psychology Research. at the University of 
Minnesota (se$ Aval I ab I I Ity, sect Ion for the address). 

Scorings are reported for adjusted scale values for the 20 
""""freed dimensions, for total circular triads (TCT), and for error 
bands. Adjusted score values indicate which needs are impprt- 
ant (unimportant) and their degree of importance (unimportance). 
Circular triads represent some i/ideclslon on the Individual}'? 
part. .Error bands Indicate the limits to which the adjusted 
scal6 value could change If the Individual were to respond In a 
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perfectly logical ahd cons I stent- manner.^ There is also a 
Correspondence Report section of the MIQ report. It presents 
Information --about the fit of the Individual 1 s need profile wjth 
the Occupational ftelnforcer Patterns (ORP'sJ for benchmark 
occupations* 4 ' *. " t 

Due to the sophistication" of the MIQ, It must be Interpreted 
"only by trained' professional personnel. t Appreciation of Its 
capabilities and limitations requires al thorough' grasp of the 
technical nature of the Instrument an£ a competence In reading 
and .Interpreting research studies on the MIQ jT^ 

The reliability of the Ml_£ was equated In Three J ways: "(I) the 
internal consistency of the scale, (2) the s^abNIty of the Mi^ 
scale scores over fime, and (3) the'stabi I Ity of MIQ prof I les 
over time. Reliability data on the 1^67 Ml£ supports the con- 
clusion that It Is reliable enough to be useful t/o the vocational 
rehabl I Itatlon counselor. , , * 

Sc^le internal consistency was Investigated by cafculatlng the 
Hoyt reliability coefficient for e^ch Ml£ sea le 'for nine differ- 
ent student groups. The median scale 'Hoyt reliability coefl- 
clent for the nine groups ranged form .77 to .81. The lowest* 

.reported single scale reliability for any group was .30, and the 
ki§it6st (found in three groups) was .95. These data indicate 
that th& individual scales have sufficient internal consistency 
reliability to meet usually accepted standards. However, other t 
types of reliability are, more meaningful' for uss with the-palr- 

*compartson MIQ . 

Hendel & Welis (1970) also Investigated the stability of Ml£ . 
scale scores for different test-retest Intervals, ranging from 
an 'immediate retestl ng> for one group'to a ten-jnonth retest 'for 
another group. The median scale stability coefficient ranged 
from .48 for^the six-month interval to .8^-for immediate retest- 
ing. The lowest reported scale stabi I it/ c6efffcient was*. 19 
(for a nine-month Interval) and the highest was .93 (Immediate 
retest). The range of scale stability coefficients for the long- 
est Interval studied (ten months) was from .46 to .79 with a 
median of .53. • 

From a cou'hsellng standpoint,^ the stability of score profiles 
Is at least as Important as that of scale scores. Hendel and 
Weiss (1970) report W]£ prof I le stability coefficients for time 
intervals ranging from immediate retestl ng to ten months. The 
median stability coefficient ranges from .95 for immediate * 
retest to .70 for, the four-month retesjj^ntepya I . The lowest 
profile stabl 1 Ity coefficient reported for one individual was 
-.44 (a high schctal 6tudent In the six-month retest group) and 
the highest was y98 (two college sophomores In the one-week 
and two-wee k^etest Interval groups). For the ten-month retest 
Interval (the" longest Interval studied)-, profile stability 
correlations ranged from .58 to .97 with a median of .87. 



These result? Indicate th^t Mlfl prof I les are relatively stable „ 
over^perjodsj approaching one year, The data also show that 
MIQ profiles are more stable th^sfri M I Q Scale scores, > suggesting 
. that profHe analys+s Is a more useful basis for Interpretation • 
thart .the analysis of scale scoresVv . * % 

The discriminant val Idlty of the MIQ Is reflected In the scales' 
Intercorrelatlons and the factor structu re of^ the MIQ scales, f 
The evidence show^tha+ v the MIQ measuresaHrfijmber of disdrlmln- 
ably different dimensions. Thus, new informatiorf Is contributed 
by each of the MIQ scales, * * 

fhe relationship of the MIQ to the General Aptitude Test Battery 
(GATB), a mu I tj factor* measure of abilities, was found to be low * 
(cross-correlations clustered around zero* with few exceeding . 
• 30) • The MIQ'S relationship- to* the Strong Vocational Interest , . 
Blank (SVIB) was high (uslftg the 1965 form of fhe»MI£ oiXVR 
applicants, Canonical correlations of .74 were obtalnedK These 
findings support tjie theoretical framework of the MJQ * 

Vanity was also examined by looking^at hew <JJ-ffer£nt groups 
perform. Data are available on nine different groups: (I) voc- 
ational counselors (N = 317), (2) retaf I /trade workers ' I (from 
one large work organization, N_= l,89"7>> (3) retail trade workers 
II (from another large work organization,^ 55 578), (4) vocational 
rehabilitation cl ients r - f,62J), C5) high school counselors p 
(JI- V)*, C6) high school students (N_= 71), (7) college students 
• (N = 71), (8) I ow^ socioeconomic status college students (J^ -125), 
and (9) vocationa l-technica I high school* women ( f£ = 285) • Adjust 
scale value mean differences among jfhese groups were evaluated- 
by an unweighted one-way analysis o£ variance for each of the 
20 WQ scales separately. Statistical ly * sign I f leant differences 
were observed, for ail 20 MIQ scales. The largest differences 
occurred for supervision - human relations, security, activity, - % 
compensation, and working conditions. For these scales, ||he * 
difference's were produced by the relatively hfgh scores <7r f he 
retail workers contrasting with 'the'low scores\6f theVstudents,. 
both high school and'eoj/fege* In other words, the contrast 
was*between those who-ttad experienced work and those who had 
not, .a fln^tLogkln accord with expectations*-^ rom the Theory. of 
Wor;k Adj^t/nerny (The-fheory is dl scussed, brief ly below.) 

In a related sl/udy, Gay and Weiss (T970) examined i"he rela- 
tionship between MIQ scale values aryi->amount of work experience 
^Indicated by number "of past jobs) for the group of l„62l 
vocational rehab! f Itatf on clients. UsI ng' one-way analysis * ♦ 
.of variance, they found that persons with different amourtts of 
work experience tended to have different levels of MIQ scale 1 
values, *the overa 1 1 I eve J v of M|Q scale values dfffered with 
differing work exper fences, and the TCT score tended to decrease 
,w4th # Increasing work experience, suggesting an Increase )n 
,the clarification of need structures. ' 1 

The- M^ was developdtT I n. the context, of the Theory^of Work 



Adjustment (Dawis, Lofqulst, and Weiss, 1968) . In part, the 
theory states that job satisfaction J s predicted by the corres- 
pondence 'between an Individual 's'needs, and the relnforcers In<the 
york environment, A>number of studies, 'Involving differing 
fields and levels of occupations' support the validity of corres- 
pondence between M1Q nefed profiles afid Occupational Relnforper 
Patterns. as a .predictor qf^job satisfaction -.(Rounds & DawJs, v 
1975; Rounds, et ak,J976) 



Ndrms pen^T comparisons with 148 occupations selected to be 

epresentaf Ive of the major 'I eve Is and fields of th^ world 
oP*work. A4^o, the booklet and answer sheet can be read by the 
average fifth grader, and Spanish ind French editions are 
available. Finally, a lot of research has been done with the 

0 The questionnaire cannot be hand scored practically, ^nd^it is 
^difficult to have^fhe computer Scoring done locally. Also, the # 
measure* was developed in the context of the Theory of Work ^ 
Adjustment; ft Is.mQst useful In that context, m • 4 

Dtfwis, R.V%, Lofqulst, *-L'.H. 4 Henly, G.A., &*Rounds, J.B., Mlnne- 
sota^Qccupatlona I classification system II . Ml rvneapol I s, Minne-" ' 
sota:- Vocational Psychology Research, Department of Psychology, 
University of Minnesota,* 1979. 

* 

.Dawis^ £.V<*, Lofqulsf, L.H., & Weiss-, D.J o . A theory of work 
adjustment Ca revision). Minnesota Studies in Vocational Rehab- 

Illtatlon: XXIM, 1933/ 
; * 

Gay 41 , Evari G., Weiss, David J., Hende I ^Darwin D., Dawis, Rene, 
& Lofqulst, LI6yd H. Maooal'for the Minnesota .importance 
questionnaire. Minnesota Studies Jn Vocational* Rehab H I tat ion : 
> XXVI II, 1971. /\ \ \ • I " 

Hendel, Darwin D. & Weiss, Davfd'J.v "individual inconsistency ' 
and rel labl I Ity of measurement. Educatlgnal* and Psychological 
Measurement, T970, 30. 579-593. 

"Rounds, ^I.B., Jr., & Dawis, ,R.V. A comparison of need^rei nforcer' 
correspondence <jnd Ices -as predictors of Jpb satisfaction (research 
• report no. 48 ) . Minneapolis, Minnesota:* *Work Adjustment Project, 
, D^rtment of Psychology, University of Minnesota, 1975. 

^Rounds, J..B., Jr., 4 Henly, G.A., Dawis, R.V. , -Lofqulst, L.H., & 
^Wel^s, D.J. Minnesota importance questionnaire user manual . 
4n press, 1981 . . • * ** 

y Rounds', J.B., Jr., SJqan, E.B., Dawis, R.V. V , & Lofqulst,* L.H. 
Work adjustment project follow-up study preliminary findings 
(research report no. 50 ). Minneapolis, Minnesota: Work Adjust- V 

Smeni Project,, Departmen/oT-Psychology, University of Minnesota, 



1976. 
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I 
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SAtfSftabllfty • The 



well as computer scoring services, can be 



^ purchased Irom 

Vocational Psychology Research 
N650 E4 I iott Ha I I 

University °f Minnesota' « . • 

, . 75 "East River Road t " 
. Minneapol is, MN 55455 

A new manual for the MIQ is currently being prepared. 
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• . ' • . ~ - SAMPLE ITEMS > 

MINNESOTA IMPORTANCE QUESTIONNAIRE 
PAIRED FORM ' - .. 

Dl rections . x . 

The purpose of this questionnaire Is to find out what you consider Important 
In ygur Ideal job, the kind of job you .would most like to have. 

On the following pages you will £|nd pairs of statements about work. 
" . - Read each pair of statements careful ly. 

- Decide which statement of the pal r Is more important *to you in your 
' 1 dea I job, . . ' 

- For each pain mark your choice on the answer sheet. Do not rrg<X this 

Booklet . (Directions on how to mark 'the answer sheet are^lven below,) 

Do this for a 1 1 pairs of statements, \4ork as rapidly as you can. Read each 
pair gf statements, mark your choice, then move orv to the next pair. Be sure 
to make'a choice far every pair. Do not go back to change your answer to any 
pair. 

Remember: ^^Yby^are ~to decide which statement of the pair is more important to 
you In your. I dea I job. Mark your choice on the answer sheet, not on this 
, booklet. ' 

Ask yourself: Which is more important to me in my ^deal job? \ 

a. I could be busy all the time 

1 . # OR 

b»' The job would provide an opportunity for advancement. * 1 - 

a. ' I could try out some of my own ic^s. 

2. OR * 

b. My co-workers would be easy to-ma#e fVlends with. 

a. The job could give me a feeling of accomplishment. 
3- x .OR 

b. I could do something that maizes Jse of my abilities. 

a. The company would -administer ifs pol icles fairly. 
f4. OR * . > * 

b. I could be busy ai!" the time. 

i 

a. I 'could try o ut s ome of my own Ideas. ¥ ' 

». ' OR ' V/ 

b. I coui(d be "somebody 1 ' jn the community. 

a* The job would provide an opportunity, for advancement. 
6. b OR 

" b. My co-workers' would "be easy fo make friends with. 
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RANKED FOm 
Directions 

The purpose of this questionnaire Is to* find out what you consider important^ - 
In your Idea 1 job, the kind of job you wduld most like to have. 
V* 

On the following pages are groups of five statements about work. 

- Read each group of statements- carefully. - 

- Rank .the five statements In each group In terms of their; importance , 

to you in your ideal job. 

- Use the number "I", for the statement w'hich is most important 'to you 

in your ideal job, the number "2" for the statement which is next 
most Important to you, and so on/ . ' 

- Use 'the number "5" for the statement least Icoportgrrf to you In your 

Ideal job, «. ■ 

- Write down your rankings in the correct spaces on the answer sheet. 



group 

- I 



group 

2 



group 
3 



group 
4 



On my ideal job. 



a . 
b. 
c. 
d. 
e. 



I could be busy all the time. 

I could do things for other people. 

I could try out some of my own ideas. 

my pay would compare well -with that of other workers. 

the job would provide an opportunity for advancement. 



On my ideal job. . . 

*a. I could do things for other people.. 

b. I could do something 'different every day. 

C the job could give me a feeling of accomplishment. 

d. my boss would train the workers well. 

e. the company would administer its policies fairly. 



On my ideal job. 



a. 
b. 
c. 
d. 
e. 



/ 



I could do the work without feeling that it is morally wrong, 
my boss you Id back the workers (with top management). 
I could do something different every day., 
I could do something that makes use of my 
I could be busy alt the time. 



abi I ities; 



On my ideal job. .. 

a. the company would administer Mts' pol icies fairly. 

b. I couldyfry out some of my own ide^s. 

- €♦ I could do something that makes use .of my abilities; 
my co-Workers would be eas^to make friends with, 
e. I could be "somebody 1 * ir\ the community. 



Reproduced by Permission. ^Copyright© 1975 by Vocational Psychology Research, 
University of Minnesota. * 
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PUBLIC ASSISTANCE RECIPIENT'S PERCEPTION INVENTORY (PARPI) 



Developer(s) 

♦ 

Purpose 
Description 



Use 



Adml nistrat ion 



Scor i ng 



Reliability 



Val idity 



The PARPI was developed by Fredric T. Scblamp.of the California 
Department of Rehabilitation. 

The PARPI assesses VR client f s attitudes about or perceptions of 
their disabi I It fee—fn relation to the work environment. 

The scale contains 22 multi-point agree/disagree statements. 
The 22-Item scale Is grouped Into six major areas: withdrawal 
reaction, necrotic reaction, dependency reaction, survival 
reaction, work valuation, and self-confidence. It assesses 
the clients perception of cofpmunity and service agency attitudes 
'and environmental factors influencing the client f s work prospects 
In the community. - 

The PARPI was designed for use with rehabilitation clients 
who had been accepted for service and who were also known to 
have been receiving public assistance payments. However, the 
developer feels that jt could be used — at least on a trial 
basis — with all rehabilitation clients, as the Items appear to 
be almost exclusively related to the client's disability rather 
than the receipt of welfare. 

The scale was developed primarily to assist the counselor in 
understanding the outlook of individual clients and in tailoring 
rehabilitation services to the needs of those clients. Program 
managers ma v y also find the measure useful In providing an 
indication of problem areas and service needs at the program level 

The PARPI Is a self -report instrument that can be completed in 
five mi.nutes. It can be administered by anyone and can even . 
be mailed to the cLIent, It may be administered during intake 
Into the VR system(^ Additional administrations may reveal 
changes in maturity and outlook. * 

The items are rated on a 5-point agree/di sagree .sea le. Each 
response is assigned a weight of I to 5, depending on the 
directionality of the item. The scores are simply the cumulative 
summation of a I I* of the item scale values within a subscale or 
the entire sea le. * ' ■ 

Factor* analysis was used in the selection of items in a/i effort 
'to support reliability and vajldlty. *Howev£r, fto further 
* evidence of t re I iabl I ity was compi led. 

• * 
Factor analysis was used In the selection of Items in an, effort 
to support reliability and validity. However, no further evi- 
dence of val Idity 'was compiled. .> * 



* 
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A major 'advantage is that the PARP1 provides counselors with., 
an early indication of how clients perceive their disabilities 
as related to the work environment. If interviews are condacted 
at intake, a 1 00$ participation is guaranteed. 

White the Instrument provides client perceptions of .employment 
potential, self-concept, and' service agency attitudes, objective 
validation of these attitudes is not presented. Evidence of 
reliability and validity needs to be compiled, * 

Bassett, Paul T. Measurement of outcome: A report from the, 
'study group on measurement of outcome. First Institute on. 
Rehabilitation Issues, Denver, Colorado, April 15-17, 1974. 
Institute, West Virginia: Research and Training Center, 1974. 

Sch lamp, F. Rehabilitation research report number 27: The 
development of a pub I Ic ass i stance recipient perception inventory 
(PARR I ) . Sacramento, California: Department of Rehabilitation, 
State of Cal ifornia.* 

Copies of the PARPI and a complete report can be obtained from — 

The Institute for the Study of 

Family Life and Mental Health 
2205 Meadowview Road 
Sacramento, CA 95832 
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PUBLIC ^ASSISTANCE RECIPIENT PERCEPTION INVENTORY 



Your opinion i£ important to ovy program staff and to our employees working with 
the* community programs in this city. Please be honest. Indicate your agreement 
or disagreement with the following statements by checking In one of the boxes to 
the right of the statement/ * This is for use in improving our services, and'will' 
not be recorded as part of 'your rehabilitation plan. You need not sign your name. 



i. 



2. 

} 
3. 



5. 

6. 

7. 
8.' 

9. 

iO. 
1 1 . 

# 

12. 

/ 

13. 



Most bosses feel that people on welfare 

want to work & . 

3 

Getting trai nihg is a waste of time "when 

there aren't any jobs 

Money is about the only thing you can 

expect in return for your work 

A person should be very particular about * 

the kind of job he takes 

The best job you can have js^one where you are 
•part of the group, all working together even If 
you don't get" much individual fcredit 

V/hen I work I imake enough money to take' care' 
of myself and my family • 

My physical health is good - . . . . 

Bosses won't hire people who haven't worked 

for a long time and are on welfare 

i 

It seems like bosses are always looking for * 
someone to bawl out. ........ 

i take pains not to get people mad at me ... . 

If possible, I have my friends with '.me wherever 
I go 

I like dtff icUlt tasks more than easy ones, . . , 

It bothers me to see someone else bung ting a 
job I know perfectly well how to manage. .* . . 



Agree 


Don't 
agree 
' or 
dis- 
agree 


' Disagree 


Very 
much 


Some 
what 


Soqje 
what 


Ven 
mucl" 


* 
























- 
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44. My feel ing$ get hurt easily when I am scolded or 
criticized 



15. It is better for me to have some job so I 
can support myself / 



16. I can. get a Job on my own withput training 



17. I do not feel up to working now. 



18. Some people who wor^ in rehabilitation offices seem 
'to think a person- with health proWems is stupid . . 

19. When workers get. laid of f> people with -health 

. ^problems are the first to be let go . 



20. I feel my life is not very useful 

2L I am able' to do things as well as most other people. . . 
22. I don*t want to be obligated to others 







- 








- 






























* 


* * 












* 
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SELF-CONCEPT OF- THE MENTALLY RETARDED Q-SORT ' 171 

Developer(s) The procedure was, developed from 1972-1974 by Roger M. Nooe ' 
of the School of Social Workat the University of Tennessee 
in Knoxvi lie* 

Purpose The spale' is designed 'to measure the change In self -concept of 

mentally retarded persons with regard to their readiness for 
community I Iving. 

Description - fhe instrument 'consists of 24 pairs of statements reflecting • 
oppostni self-characterizations. Each statement appeals on a 
separate card, f hence 48 car^Js In total. As indicated, self- 
^ concept 7 as it relates to the mentally re+arded clients readi- 
ness for qommun/lty living is assessed. The cards relate to 
serious aspects of self-perception '(e.g., I am* a good person vs. 
I am a bad persfcn, I am smart enough vs. j am dumb, I I ike to 
decide things for myself vs. I always II ke others to decide for 
me). „ ^ 



Use Wh 1 1 e the procedure is designed to be used wi th menta I ly 

retarded adults, the developer suggests that It is useful with 
* other groups. -It would seem to b$ appropriate in sheltered 

workshops, rehabilitation facilities, and educational facill- * 
ties. 

^ ^ ' The instrument is useful to .both case managers and program 

* managers. The results can alert the esse manager to specific 

needs of Individual clients, progress made,Aid readiness for 
community living. It Is useful to the program manager in 
assessing the impact or effectiveness of program strategies. 

.'\ * It should be not€d that the developer wanted to demonstrate 

how evaluation instruments cap be tailored. Therefore, 
interested parties should feel free In following this procedure 
• • by collecting statements from their own population or by 

adding pairs of statements t9 those contained in this tost foment. 

Administration This is a aeLf-report procedure where! n the client places all 

it" J oi the cards in two piles (e.g. ,*frue, like me and false/ 

• & unlike me). The cards are first administered within two/ weeks 

after arriving at the project and again six months later?. 
At the second /testing most client^ were in the process pf 
making plans to move into the community. The cards wei^e 
administered as a Q-sort procedure. Time required is/approxi- 
mately 30 minutes. ' * • / — 



/ 

/ 



Scoring ¥he scoring ca'n be done by hand and takes approximately five • 

_ minutes. Frequencies of J>osliMve and negative characteriza- 

Ions pre determined. These* cumulative positives, and negatives 
i# ^are compared at dj f ferent -tlme^ In the program, /interpretation 
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of the result^ can be made by someone traljjeri in social worker 
psychology. * . - / 



Reliability | A reliability study was conducted b.ut no data^were reported 
' In the materials reviewed. 



Validity 



Advantages 



Limitations 



References 



AvSilabttity 



The validity of 'the cards was assessed by an Independent judge 
who ranked residents of a /ransi tiorfaJ living facility for 
mentally retarded adults on the basis of positive self-concept. 
A Spearman rank correlation of .75 (significant at .05*) was 
attained between the judge T s ranking and a rankorder based on 
each nesident f s selection of positive items. - ^ 

The ability of the Q-sort cards to assess Readiness*, for com- 
munity living is reflected by the fact that those residents who 
selected a high number of positive Items and a low number of 
negative items moved to a higher level of Inflependence. than those* 
residents who selected £ low number of positive items and a 
high number of negative ones. 

A further lnspection*of the data indicated that an association 
exists between positive self-rating arffT movement toward higher 
ley&ls of ' Independence. ^ To compute the correlation between 
resfdeot movement and the Q-sort differentialscore, a Spearman * 
.rank correlation coefficient was used and recorded rho = ;80, * 
(£^.05)v The data support a relationship between self-concept 
and independent living and suggest that the approach has 
predictive val idity. 

A fPfth-grade reading abiMty is necessary to'complete the task. 
However, ,<the statement can be read aloGd by the client or the 
examiner; therefore,* reading .deficiencies do not interfere 
with responses. Second*, the procedure* is spegi+ical ly designed 
for retarded adults. Third, the procedure relajds to skulls , # # 
necessary In successful community living. Foufth, since the 
statements were' originally developed from IIsts of client- 
statements, it overcomes the major weakness of self-concept 
scal'es that reflect the bias of tfie researcher instead of the 
thinking of fhq subject. 

• * * 

The reliability and validity fiave been measured with very^small 
samples. Replication with larger samples is necessary. 

, * . * 

Nooe, Roger M. Measuring self-concept of mentally retarded 
adults. -Social Work. 1977, 22 C4), 320-22.' ~ 

A listing of tf\e 2'4 t pairs of statements . used 'iri this procedure * 
can b§ obtained from — . * „ 

Roger M. Nooe,* D.S.W. 
\ .The Un-lvershty of Tennessee 

* ,Sch6ol'o v f Social Work — Knoxville Branch 
905 Mountcast I e Street 

Knoxvl I le, TN ^9I6 % 
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I.' 

2. 
3. 
4. 
5. 

7. 
ff. 
9. 

lo. 

II. 

12. 

13. 

14* 

15. 

16. 

17. 

18. 

19. 

20. 

21. 

22. 

23. 

24. 

25. 

26. 

27. 

28. 

29. 

30. 

31. 

32. 

33. 

34. 

35. 

36. 

37. 

38. 

39. 

40. 

41. 

42. 

43,. 

44. 

45. 

46. 

47. 

48. 



SELF-CONCEPY -of THE MENTALLY RETARDED Q-SORJ 



thlnk'that I look 0!K. 
do not like the way I look, 
am a good *p*erso£. 
am a. bad person, 
am as good as sOther people. 
Other people ar4 better -than me. 

think that it fs alright to feel angry somet.imes. 
think that it is wrong to ever -feel angry, 
am smart enough. V- 
am dumb. s 
My feelings are not hurt too often. 
My feelings are, hurt almost everyday, 
can hold a job. 
cannot hold a job. 
want to do things for myself. 

do not want to <do things for myself, 
can learn about new things, 
cannot , learn about new things.- 
want to do my own grocery shopping. * 
want someone to do grocery ^shoppt ng for* me. 
V/ant a job instead of k welfare check, 
want a welfare check instead of a job.' 
like to gd to new places, 
do not like to go to new pi 
Everyday I do thi ngs. better. 
Everyday I, do thlogs worse. ' 
sometimes make mistakes, 
never make mistakes. - / 

am a. healthy person, 
am a sick person. 
Things should be be.tter for me in the future. 
Things will be worse for me in the future, 
enjoy being with (girls) (boys), 
do not like, being with (girls) (boys), 
have some friends, 
do not have any friends, 
can tell other people what I think, 
cannot tell Other people what I think. 
Sometimes I like to do* things by myseff. 
never like to do anything by myself, 
can make friends; 
cannot make* friends. Xj 
like to meet people. « 
do not likevto.meet people, 
would ask someone If I need directions, 
would not ask anyone for directions, 
like to decide things for myself, 
always like othfer people to tefl me what to do. 





q Reproduced by permission of Rbger Nooe.* 17q 

erjc :.; ' ' • •- .4 . J 




4 



t 



# 

* 

MEASURES OF CLIENT SATISFACTION »* 
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CONSUMER'S MEASUREMENT OF VOCATIONAL REHABILITATION 
I ' FORMS B AND B-l 

v 

• % 

Developer(s) Forms B and B-l were developed by William G. Hills and 

Harold D. Vi'aille at the Regional Rehab! II tat! on Research - 
Institute In Administration and Management at the Upiversity^ 
of Oklahoma. Form B-l was copyrighted in 1973 and .Form B 
was revised and finalized in the mid I970 f s. 

Purpos^^^ Both Instruments -are designed'to measure client satisfaction 
with agency services and thus program evaluation. They are 
not Intended for use in the evaluation of specific counselors. 

Description Form B (Consumer Measurement Scale) contains 28 core ^ifems t 

covering nine f actors^phas^a^of, the rehabilitation program. 
The majority of the items are* mu I tl -poi nt satisfaction - 
• — . dissatisfaction scales. Client satisfaction is purported . 

to be measured along the following dimensions: speed of 
- -* services/ medical services, traitdrrg services, employment 

satisfaction, participation in planning, counselor eTfort in 
placement, agency policies, physical facilities, and personal 
treatment.^ Additional demographic and .open-ended items are 
also Included. Form B-l (Fol low-up Questionnaire) contains 
i 17 items that s.eek information on the client f s employment 

-and the role of vocational rehabilitation in helping him/her 
? . obtain that employment. AM but one of the items are multl- 

4f ^olnt; one is open-ended. ^ 

-\ 

Use. . The instruments are appropriate formal I yR clients and are 

designed primarily for use. in the state-federal VRS. Both 
forms are designed for program evaluation — comparing one 
district office with other district offices; comparing the 
relative ratings of Internal factors such as counsejor effort 
irr placement, participation in planning, agency policies, > 
etc*, with 'external factor^ — those supplied by perso^ out- 
— si<Je4he direct control and responsibility of the agency — 

such as medical treatment and training, etc.; and comparing 
the actual rel atlva rafikl ngs with the relative rankings that 
district of f ice, managers and field servic^ chief s thought 
would be the outcome. 



\ 



k The Instruments attempt^to assess important aspects of the 

rehabilitation process as an aid to' case manager? and program 
- managers. The i nstruments..3re usef u l t In determining the client's 
t perception of how effectively program resources, including 
rehabilitation counselors, are used to attain program goals. 

Administration Forms B and B-l are^se I f-report questionnaires which are Coy- 
j pleted by the cllenT and returned in the mail. The instruments 

are administered after closure*and can be completed In a minimal 
amount of time. 



"1 y 



1*?8 



b 
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Scoring The scaring of tfie^ core I teiqsT.. Involves trie* assignment of nega~ 



♦ tlve pdfints for responses Indicating dissatisfaction and posi- 

'* tlve points for >e^jr6hses indicating satisfaction. This* allows 
a profile to be drawn which shdWs 1*he general satisfaction- 

r of consumers ori the ninelfactors as welJ as the.ir satisfaction 

. * •? on each factor, Tte scale ranges from -2 (very dissatisfied) 

* V t *- * ' 'to a +2 (very satisfied). Zepo signifies a neutral response. 

% i • The levels of satisfaction can -be del I neatdd further: 'How 11 

m '* .areas of satisfaction range from 0 to 4- . 70 , "medium^ areas 

..>,- " . # range from +>7I ,tb + l\40, and- "high 11 areas range from + l.4*h 

~ k * „ to +2. The same weights, only negat i ve,> app ly to the levels $ 

/ ' e - of dissatisfaction. Thesejweighted area* of satisfaction may w 

# f * ' ^- vary with each agency .analysis due to the variance of the, 

. * < * ' f popu I at I oh.. " 

%' The scores can ^hen* be examined in terms of .trends, movement- 

from, one year- to The next, and the relative scores on one * ♦ 
, * * variable as contrasted ^ith another variabjte — end in light* 

, of the^mission, gocils, ^afaJ^plans of the agency. 

t • The core items canr be machlne'or hand scored. 

AJb .Reliability § The developers- present the foj lowing in support of the relia= 

* * iJ t ^ w bility of form B. The >eore items are profess iona I I ^object ive, . 

. based on the ,i nput *of . rehabi I i^tion professional. The '* ^ 
original 4$-item questi^nna i re was developed from, a ^Mst of 
" . \ over TOO items"*submi tted by" over 30 counsB lors,** £upervi sors, 

* m'ujdle man^gement^perso^rlel , chiefs of fFelti services, and 
* * , sta^e directors of vocational rehab'j I i tatlon. Data was then 

gathered on the original '48- item questTonna i re in three states 
- v x from six fiscal yehrs+ Factor analysis was performed to im- 

« % * . J, , -/prove the measure ll^Twenty-eight .itejps were maintained in 

//* ' a j " Form B; the\f actor l&ad i ncj^ for a I Tj terns were, above t 40 an3* 

- d . M -a.il of the items* clustered together withhn subcategories. 

- t , v . .\' Also;-f%£pbnses on the 28 core Items were compared to**he ; ' % 

^ » vt , open-ended adS it ion^^l comments item. The additi6nWl comments 

J/ • " were categorized jfrtop sa+isfied, neutral, and^dissa^l^f ied 

^ * * s : ^ • ( . groups. There wa*s, a "Stat i st ica I ly t s igfoi f l^cant (£<.00l) / 1 

% " ^ » ! m . J diVect relationship bbtWeen the comment^ and the responses on 

the 28 core Items.'. Highly satisfied clients as measured by 



the core Items were highly satisfied as ref lecte^jjw the 
additional commits.- + • 



\ .Validity Jhe devejop^rs jyresent the fqM owing in support of y the, validity 

of Form -ThB, orlgi na L" 48-i tern questIon%Jre wasidevejoped 

.* > \ . ' ^ ^ f rom a^ffst dVover 100 iVems ^submitted by over 30 Ite'unselojis, \ 

* j* * , supervisors, middle management personnej ,^ chiefs of'ffeld * • 

/ * ' * ! • ^^servjces, and state di rector^ of vopSational rehabilitation^ 1 

* ♦ • Data J/iyoiving three states ^/ere a3a lyzsd. from six fiscal ,\ - 

- k yeacs* Factcy analysis was performed, to Improve .the measurey. 

- ^ ; * _ t ^yenty-el'ght It^ms^ wer*e ,mgl ntal ned^ln Form. the tfactor load- 
\a If '#l ># Ings-fcii? all litems we r©- above .40 and. all of the iterfis clusterec) 

' ^ •. tbgetber within subcategories. 



9 . , ^ - 



TfrtiJvanttfges Both forms rrely on self-Veport and can be completed quickly. 



Limitations 



References 



Aval labi I i ty> 



The instruments are not designed to measure'cl ient change, 
The^ ^re not intended for client evaluation but >fqr -program 
evaluation — to evalua+^the parts anfr^hole of the agency 
as a means of improving' the publ ic administration of the funds 
/ .a'nd perspnnel working/ in the public sector of vocational* 
rehab i. U tat I on • 

* <* * I 

Bassett, P. T»* Measurement of outcomes: A report from the 
» study group on measurement of outcomes . First Institute on 
Rehabilitation issues,, Denver, Colorado, Aftri! 15-17, 1974* ' 
Institute, West Virginia: Research and Training Center, 1974. 

Factor analysis of consumer's satisfaction reduction of Items 
or] the questionnaire . Urlpublished manuscript. 

Program Analysis Sect ton, *North Carolina Division of Rehabili- 
tation Services. Consumer! s measurement of vocational rehab\li- 
tetion services: A pilot study in south f^ntral region, phase I 
' report , Ralejgh, North Carolina: Author, February, 1975., 

The iterfruments and other pertinent information can be obtained 
from 



\ 



Wi I HaTh G. Hi I Is, Ph.D. 
1 005 - 18th Avenue Sooth 
x CranbrooK, British Columbia 
' CANADA - VIC A SI 



\ 
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SAMPLE ITEMS 

* 180 . . * • 

CONSUMER'S MEASUREMENT OF VOCATIONAL REHABILITATION 
■ «FORM B: C&NS.UMER MEASUREMENT SCALE 
(REVISED) > 

Tnaok you for your thme and assistance. Your response to this questionnaire 
wi U be kept confidential ana will be i nterpreted^ on ly ix> identify the strengths and 
weaknesses of rehabj I itaflon^services. 

Please complete the following 28 questions while asking yourself; 
s, • How satisfied am I with this aspect of rehabilitation service? 

Very s&t . means I am very .sati^j^* * 
Sat . means^Tamsatisifed. ^ 

* , H_. means 'I carPTllecIde whethePH am satisfied or not.r^ 

DIssat . means I am dissatisfied. . * ■ 

' Very dtssat . means I am very dissatisfied^. T~' J** 

C.N.A . means thls\item^ does not apply to me. " * 

Please^ place a cbe6K ma\k^in tlje t^x that best explains how you feel about 
each statement. 

+ v v \ Very " * Very 

Jt ' . ^ — s^t. Sat. ' N DIssat. DissalV D.N 

1. The qual Ity of tralni ng I received... / j - 

2. My Counselor's willingness td listen to / w m ' 
my ideas and suggestions , t Mm— - 

, 3. The t'me it took' to approve me for \, 

service ^ 

4. The q/nount^of training \ received.... ^ _j ^ fa 4 , 

5. The office loc&tion. /. fc ^ ' _ 

6. Quality of medical services - ' " _ 

7. Benefit oft^raining I received*. ' _ 

8. " The^ &np loyment* I now have " L ' ' * 

* 9. Promptness of medial service - . _ 

10. Innd of tra In 1 ngj .received v . * - f _ 

11. Vocational Rehabilitation's ability • » 
I* to make decisions - m . # ^ 

12. Th|,o*ff lce,4tselt .' _ 1 , _ 

13. My counselor's .dlscus'sing with -me ^ 
^different jobs^nd job openings 

14. My part In planning for*my job.. _ L _ ^ ; : m " 

* Very * ■ Very 

^ 4 1 Sat. Sat. N- DIssat. DIssat. D.N.A- 

■ . 181 ■ 
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Sex: Male | . | Fema I e ( | Age 
Disability & 



r 

'st grade "completed fn school 



Present Job 



Other training you-have received 



Years ccxnpleted In college , 




ce: White |~| * Negro □ Indian □ ^Spanish □ Other | | 
Refepral: I referred myself td $ [ | Someone else referred me . • 

PI4ase answer each of ,the following: y - - V 

(1) Would you return to Vocational Rehab i 1 1 tat ion OTO) should you again have need of 
VR services? Yes Q No j_] ^ 

(2) Do you think the services provided by VR h elped you get a bettec job than you 



would have found without VR- services? Yes 



/ou qet 
No □ 



(3) In yoi^" contact with VR," did you ever in any way experience discrimination? 
Yes LJJ No \Z3 • ' 

* ' \ 
How do you think rehabilitation services could be improved? _j * 



Additional Comments: 



We are interested im knowing what happens - to people af ter Vehab'i 1 1 tat ion se^k:es 
end. Would you be will i nq t o complete, another questionnaire for us^about six, months 
from now?' . Yes No Qj ' 



If yes, pi ease, print your name and' address so v| 
Na^ 



vie ^ah 



dnes 



send you the follow-up questionnaire 



Address 

& 



Street 



'City 



State 



Zip Code 



Reproduced by pennissio^NsQogy right by WJIMam G. Hf lis, Ph.D.,* and Karold D. 
d u 1«H lie, Ph.D. . _ ■ 

. •; . "A '■ - m 1 ' . v ' 1 =( 

- - ' - -VV-^--- ■ * ,\.. - .-s-v- 
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CONSUMER 1 S, MEASUREMENT OF VOCAlloNAL REHABILITATION * # . 

FORM B-l: FOLLOW-UP QUESTIONNAIRE 



I. Are you employed at this time? Yes 



No 



Note: If no, please skip questions 2, 3, and 4. 



.2. Are you working for the samb ,emp loyer you were six months ago? 
Yes ■ | No m . 

3. Are you doing the same kind of work you were doing six months ago? 
Yes No 



4, How satisfied are you pith your present job? 
Very Satisfied Satisfied ' ' - 

r 

Dissatisfied Very Dissatisfied 



Nfeutra I 



5. j How many^months during t(ie last six have you been empl.oyed? 
< i 

0 1 2 3 4 



- 6 



6, How many jobs have yA^Jiad fn the last six mori+hs? 1 



0 

5 



6 or more 



*7. Have^you again applied for rehabilitation services? 



Yes 



No 



8. What else could the Vocational Rehab I J f tat Ion program have done *fiat would have 
been*of help. to you In finding or keeping suitable employment? ' / 



. . . 183 - ' 

Ask Yourself: How satisfied am I with this aspect of rehabilitation servj-ces? "~ 1 

> Very sat / means < am very satisfied. 
Sat , means i am'satisf ie6". 

N. means I can't decide whether r am satisfied or not.* • 
Dissat . mea^s I am dJssati^f led. 
Very dlssat . means I am very ;dissat!sf led. 

D.N. A. rqeans this item does not apply to me. - 

Please place a check mark In the box that best explains how you feel about 
each statement. • ' 

Choose an answer for all statements. 




ERIENCE WITH VOCATIONAL REHABILITATION, THIS IS THE WAY L FEEL ABOUT 



\ 



Very \ Vfery 

- Sat. Sat. N Dissat. Dissat. D.N. A. 

9. The time it tdok to get the • 

services -S^tapteS^. ..... .-. ^ ; t . 

10. Results of medical services % 

'II. The quality of training I received , 

12. The employment I now have 

13. My counselor's willingness to ~* 
listen to my kiefcs and suggestions _ ( ^ 

14. The part my counse lor>D layed in 

'actually helping me ge# my job.... " ^ • 

* 15.. Vocational Rehabilitation's ability / - 

to make decisions '.' ' - S ^ 

, 16. Ease with which I could enter il\e * s 

office..*:." n ' 

17. Personal treatment I received from 

Vpcatlpna I Rehab 1 1 1 tatKon _ ij . ^ 



. Pleasa/put this questionnaire in the attached envelope an^j mail to the Regjpaal RehabI li- 
gation Ifissearch Institute. Thank you- for your cooperatiorkJ* • — J ' fc 

' < " v Questionnaire Number 

' ■ T J " ' '* 

• i ' District Number ' 



Reproduced by permission* Copyright 1973 by WIIMam G, Hills, PlnD,, and 
Harold D. Vlatfle, Ph.D. ^ 

E M ;■■ ■ : . , 18.4 
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EMPLOYEE QUESTIONNAIRE OF THE WEST VIRGINIA FOLLOW-UP KIT " 

Developer(s) the Employee Quest iof>ni are was developed at the West Virginia 
, Rehabilitation Research and Ti^iryjjig Center fn 1974. 

Purpose The » Employee Questionnaire is a follovN^p i nstrument .designed 

to assess client satisfaction with rehabilitation services, 
as well as a number of other factors related to employment. 

Description The instrument has five subscales and a total of 42 forc'ed 

choice items* Items 1-11 are general qTJestions regarding 
current work status and satisfaction with servi-ces^ TJhe first 
subscale, the Hoppock job Satisfaction Blank ( itemsfyz-15), / 
yields a global measure of job satisfaction. The Tseng Work > 
Personality Subscale (items 16-26) yields a global measure of ' 
the individual's assessment of his or her own personal quality 
in the work situation; It a'ssesses the following character- 
*~ istics: abS I »ty to work with others, punctuality, coopera- 
tiveness, sel *-rel i ance, appearance, courtesy, motivation, 
reliability, *ork tolerance, initiative, and attitude toward 
job. The Tseng Work Proficiency Subscale ( items 27-32) pro- 
vides a measure of the individual's assessment of his or her 

_ _ -~ WO rfc prof iciency along - ther-fo lowing areas of job knowledge;*^ 

job skills, quality of work, care and operation of equipment, 
observance of safety practice, and compliance with work rules. 
The client's sei f-acceptance (items 33-35) and attitude towari 
work (items 3c-38) are tapped by seven-point semantic 
differential scales making up the fourth and fifth subscales^ 
ltems i 39-42 a~e, relevant only for .married cl ients. 

The majority pf the items are five-point ratings (e.g., agree/ 
disagree or satisfied/dissatisfied); however, a minimal* * 
number require ff yes-no ff or objective responses (e.g., level 
of education, present employer, etc.), 

Uge^ The instrument is appropriate for all former rehabilitation 

clients, and If was developed* for use in the state-federal 
rehabilitation system. Th^ instrument is beneficial to both 
case '-managers and prograrjumanagers. Information about former 
clients 1 vocational status and VR*s role ia 'attaining that 
employment provides case managers\i th an indication of their 
effectiveness.* This information provides program 'managers 
with an indication of the fmpact of the rehabilitation program 
upon clients, or program effectiveness* Other pertinent 1 
information gathered on the client's perception of the 
importance of work, relationships with signi,f icanl* others, 
and their perception of the, world of work may, prov ide* reha- 
bilitation workers with a more complete understanding of ' 
' clients 1 success and failure and program success, and * f a f I gre, 
Thi's information is beneficial In planning more successful 
' - programs. , » . 



* 
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The Employee Questionnaire Is a self-report Instrument whlcti 
is administered after closure. It Is recommended that the » 
administration occur at least one year after closure in order 
.to obtain some measure of the lasting impact of rehab i I i- tat I on 
services. The instrument is mailed to former cJients and they 
are instructed to complete and return them. It can be com- 
pleted In approximately 15 minutes. % * 

The Employee Questionnaire data can be compiled in two ways: 
one for computer analysis and th£ other for hand or machine 
calculation. Either method uses the computation of totals, 
frequencies,- averages, percents, and standard deviations. 
(Forms for compi I i$g the data are included in the Follow-up 
Kit). If computer services are available-, correlational 
analysis, t-tests, and analysis of variance may be use£ to 
strengthen evaluation reports. - . 

t . 

Composite scores for job satisfaction, work personality, , 
attitude toward work, 4 and self-acceptance can be generate* 
for groups of former clients. Composite scores are obtained 
by countir^j and then averaging^ I I attributes associated with 
the particular factor. Then by adding the averages for the 
attributes, a composite score is derived. This permits corn- 
par I sens~DT cfi f fereTTf' gFoupV of former cTFenT^Te.g . ,~T"hose~ ~' 
closed in Status 26 and tfiose closed in Statuses 08, 28, or 
30). Comparisons of the 'perceptions of former cl ients and • 
their respective employers is possible with' the use of the 
Employee Questionnaire and the Employer Questionnaire, also 
part of the West Virginia Fo I low-yp .Kit. 

Reliability data are available for s<5me of the subsca:les: / 

The'HoppocJ< Job Satisfaction BlanR"( items 12-15 on the 
Employee Questionnaire ) is reported to <<have the split-half 
reliability of .87, corrected by the Spearman-Brown formula s 
to .93 (N = 103). The Tseng Work P#fsonality Subscale* (items 
16-26 pn the Employee Questionnaire ) has the split-half • 
reliaBTiity with the Spearman-Brown .correct ion of ,80 (H = 113). 
The Tseng Work Proficiency Subscale (items 27-32 on the 
Employee Questionnaire ) has the split-half re! iabi I i t/ w^th 
the Spearman-Brown correction of .87 (N = 113). The total 
Tseng scal,e, the composite of work personal itv and work profi- 
ciency sqbscales, has. the split-half reliability with the 
Spearman-Brown correcticfri of \88 = W = U3). 

The Tseng Work Personality Subscale has the internal con- 
sistency as' measured by Cronbach's alpha of .86 CN = 113). 
The Tseng Work Proficiency Subscale has an ^Interna* con- ' 
siste/icy as measured by €ronbach f s alpha of'.84'(N_ = 113). 
The total Tseng scale, the composite of work personality k 
and work proficiency subscales, has the interna \ consistency 
{Cro/ibacH f s/alpha) of .89. (N = 113). - * 

Byldence of validity fs available on one of the lubscales: 

The Hoppock Job SatTsfgtr^ (Items 12-15 on the 

4 * 
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Advantages 



Limitations 



References 



Employee Questionnaire ) and a 51-item General Job Satisfac- 
tion Scale developed by the University of Minnesota Industrial 
.Re I at Jons* Center *were a dmtjjj Stored* to a sample of former 
cl ients" of the West Virginia Rehabilitation Center. A "very 
hi gt> correlation- of .93' (N = 52, £< .001). was obtained between 
the two job .satisfaction .measures. 

Some of the advantages of the Employee Questionnaire include 
the fbUowing:' 'it fs self ^administered; attitudes an'd opin- 
ions requested provide information about re levant' and signi- 
ficant concerns of rehabilitation agencies, rather than simply 

^asking if clients liked the services; and the manual *s sped- 
fl.pity and 'comprehensiveness make it a valuable asset to users 

.who cfibose^to mpdi/fy or develop their oWn questionnaires. 

Some of "the limitations of the Instrument include the following: 
since no pre-measure is made, change cannot be adequately 
" demonstrated; considering the.lengtfc of the instrument, it 
is uni ikely ^thalythe response rate will be great if mailed; 
and- the use Q_f tpe instrument In personal" interviews seems 
impractical due to the expense. 



Bassett, P. T. Measurement of outcomes: A' report from the 
- -study ^qroujuon measureroenjLof outcomes . First Institute on 
Rehabilitation issues, Denver, Colorado, April 15-17, 19.74. 
tbte, West Virginia: Research and Training Center, 1974., 



i 



Instl- 



Avai lability 



G reeve r, 
study of 



K. B., Minton, 
rehabi I i tat ion 



Institue, West Virginia: 



E. B., & Tseng, M. S. Fo[ low-up 
clients - a step-by-step guide . 
Research and Training Center, 1974. 



The West Virginia Fo Mow-up Kit, including the Ertlp I oyee 
Questionnaire and tfte Employer Questionnaire, can be obtained 
from.-. — 



Pub I i cat ions Department 
West Virginia Rehabilitation 
* Research and Training Center 

One Dunbar Plaza, Suite E • 
Dunbar, WV 25064 

In addition to the questionnaires mentioned above, the kit 
contains information on planning and conducting a follow-up 
study^, sampling, analyzing the data, and writing the report. 



/ 
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SAMPLE ITEMS , . \ 

* - .> 

EMPLOYEE QUEStlOflNAIRE 

* * 

I3 #/ Circle ONE of the following to show how much- of the time you* feel satisfied 

% W tt? y ° Ur J ° b ' m ~ ' 

» I • Ail I the time * %f 

2, Most of the time , 

3. A good deal of the tim& ' * 

4, About half of the time . 

5, Occasiona My 

^.Seldom * ) • 

7, Never fc 

H5, Circle ONE of the fojlowing to show how you think you compare with other 
people, / * \ 

) \\ one KXes his job better than I like mine, 

.2. I job much better than most people like theirs, 

3, my job better than most people like theirs/ • 

4, yi like my job about as well as most peopled ike theirs, 
1 dislike my job more than "most people dis I i te^thai rs, 

6. I dislike my job much more than most people Ins I ike theirs. 

7. No one dislikes his job more than I dislike mine, 

16. I don't have trauble with my corworkers. 
v 

1 . * Strongly agree 
. , ■ { 2, Agree s . 

3, Uncertain 

* ' 4, Disagree ■ 

5, Strongly disagree 

17, 1 go to work- on t'inje amd return from breaks on time. 

* I , Strongly agree 

2. Agree ' „ 

3. Uncertain 

4. Disagree m 4 

> 5, Strongly djsagree* ^ 

18. ^ I get along well with my £up§rvisor, 

1. Strongly agree . * 
I • 2. Agree * m * 4 

3. .Uncertain h ' % n . . • 

4. Disagree 

5. • Strong J'y disagree , j 

19, I get my work done without being told by my supervisor, \ * 

; * ' I.^^Strongly agree 

2. Agree ~ ' # ' . , 

3. Uncertain . 
" 4* Disagree 

5, Strongly disagree 1 ' i ' 

: • ._iw-^'-aai .,=..188. ■. 
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27. I , think my know I edge 'about my job Is 

1 . Very sqod * * , 

2. Good 

3. Fair 

4. .Poor 

5. Very Poor \ 

28* My work skill In the trade is * 

1. Very good 

2. Good- 

3. Fair • ' 

4. Poor 

5. Very^poor * 

34. I myself am ' 

1. Extremely satisfied 

2. Quite satisfied- 

3. S Hqhtly satisf ied ' 

4. Neither satisfied nbr dissatisfied 

5. Slightly dissatisfied 

6. Quite dissatisf ied 

' 7. Exthemely dissatisfied 



37. The world of work is ■ 

1 . Extreme I y importanj 

2. Quite important / 

3. S I ight ly important^ 

4. Neither rmportant nor 

5. Slightly unimportant 

6. ^ Quite unimportant 

7. Extremely unimportant 



It 



'I 

unimportant 



* * 



■ J 
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'Reproduced by permission of the West Virginia Rehahl Htatlon Research and 
ro?r Traltilng Center ♦ ^ • * 



* * 

MINNESOTA SATISFACTION' QUESTIONNAIRE (MSQ) . 



The MSQ was developed'by Dayid J* Weiss, Ren6 V. Dawls, 
George W. England, and LToyd H, *LofquI^t at the University 
of Mjnnegota ancKrevised and copyrfghted by* Vocat iona I . 
Psychology Research at the University of Minnesota in 
1977. i 
* * • 

The, MSQ is designed to measure an . i ndi vi dua 1 1 S satisfaction 
with" hi s/her.job. * 

The MSQ (long form) consists of 100 items, -each referring to 
a reinforcer in 'the work environment. The client is askfed 
to indicate how satisfied he/she is with the reinforcer on 
his/her present job on' a five-point Likert-type scale,^ 

The fiSQ consists of 20 scales, fSjj^h consisting of five items: 
abi/i ty utilization, achievement,, activity, advancement, 
au"rfcj>rity, company policies and practices, compensation, co- 
worke^^NaCpecn ivity, independence, moral values, recognition, 
responsibility, security, social service, social status,* 
superVision-human'relations, supervision-technica I , variety, 
and working qonditions, A general satisfaction scale is 
also embedded, in the it§ms. " , s 

v ^The MSQ . is 'appropriate for use with vocational rehabilitation 
clients and/or employed persons in any setting* Counselors 
and program managers alike can* benefit from the infdrmation 
this measure yields. Counselors can monitor their own effect- 
iveness in finding clients jobs that consider their individual 
needs.. The. effectiveness of counselors and various counseling 
techniques can be assessed using these data as' outcome measures 
Als<5, when systematic fol low-up studies are ponducted,, new data 
along with norm group data, ar'l ready avai lable,^£an be examined 
to better identify those relnforcers that are important in 
different jobs. Then vocational plans can be ^bstabl ished 'that 
consider and enhance client satisf actiorTknd keep him/her on 
the joS* longer?. < 



A short-form MSQ is also avai I able. ^fft consists of 20 items 
and yields three scales — intrinsic satisfaction, extrinsic 
satisfaction, tfftd general satisfaction"." It takes, about five 
ml nutes tq complete, and some norms are available.^ However, 
the long form is .preferred whenever pos^ble because of the ■ 
Increased information obtained for only a small difference in 
admi«nJ strati on time. # ' % * 

Res/fonseT^are weighted from I to, 5. Raw scales are determined* 
by summing tho^welghted scores for those Items In the scale. 
An i'ndlvjf dua I f s scores for the scales'can then be ranked and 
Interpreted relatively'. 
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Raw scores for the various scales can also be converted to* 
percentile scores based ofi the most appropriate norm group 
for the individual ~ — that Is, those in jobs that correspond 
exactly to the client's job. Conversion tables ^re available 
for specific jobs withfn the following broad categories: pro- 
fessional, technical, managerial; clerical, sales; service; 
bench work; miscellaneous. If norms are not available that 
match the client exactly, (I), select with care a group that 
is very similiar.t© the client, considering a number of 
characteristics — tooTs anfl materials used, tasks performed, 
type of supervision, rate of pay> and" physical working condit- 
ions; or (2) use the broader "Employed Disabled" or "Employed' \ 
Non-di^ebled" norms, Ordlharily, a percentile score of 75 or 
higher Is considered to reflect a high, degree of satisfaction, 
26 or lo.wer indicat^S"~3 low degree of satisfaction, and scores 
in the middle indicate average satisfaction* * 

The MSQ can be hand scored using information provided in the 
manual. Computer scoring is also available from Vocational* £ 
Psychology.Research a*h the University of Mi nnesota^(see 
Availability section for adcfre^s)'. , Output from scoring can 
include raw scores by individual, printed~and/or on punched 
cards, and group means, standard deviations, and reliabilities. 
Additional analyses (e.g., group differ^ces I n sc^+e' scores, 
intercorrelations, etc;) can be arraYiged. ^\^/^^ 

Internal consistency 3s measured by ttoyt~ ! s analysis of variance * 
method yields Reliability coef f icien-ns on 27* normative groups 
for the MSP scales ranging from .59 toV57 with medians ranging 
from .78 to .93. Of 567 coefficients reported, 83$ were .80 or 
hidjher and only 2. 5% were lower than .70. Because the reliabil- 
ity 'of t s6me scales tends -to vary across groups, it is F^corimend- 
ed tfiat^coef-f icients -be computed for a sample of the group, pn 
which. the MSQ is used. ; ' ' 1 

Test-retest correlation coefficients fpr the scales were dt?- 
tainejj for two time intervals — one week and. one year. Tpe 4 
one-week Interval group consisted of ,75, emp Ipyed Qjght scjfool 
students in psychology and industrial ^relations cqlirses and 

* yielded stability coefficients for the scales ranging from 
• 66 to lai'with a rrledian coef-f icient of .-83. The one-year 
interval group consisted of J 15 employed individuals and -was 
heterogeneous with respect to* the presence or absence of dls- 

. ability as well as *tvpe* of disabi I ity. Stability coefficients 
' ranged from .35 to'. /I with a median coefficient of .61. 

* ~ . \ * 

Concurrent va I Id ity was examined by looklftg at group difference^ 
In satisfaction. Mean -differences were tested bv ofte-way ■' 
t^»analysis of variance,, and differences -in variability were, tested 
by Ba'rtlett's Irest of. • homogeneity,. of variance. 25 occupational 
groups were studied (N; = 2,955V'and group differences were slg- 

* nlf leant at the .00*1 Tevel for both meahs and variances on all 

* .21 scales, Indicating that the M§£ scales can dK fere'ntiate among 
'occupational groups* * *' - ^ 
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Differences In satisfaction between those with disabling /), 
conditions and thtfse without 'were als^examined. Stat is- % 
tlcajly signif icantjJifferences* ( (at*the^05 level or less) t 
in mean satisfaction levels occured on I I of the* 2 1 scales, - 
with the ttfeablecJ group scoring significantly lower than 
the non-disabled group'. Means on the remainfng 10 scales 

so yielded consistently lower scbres'for the disabled 
group but were not statistically significant. - Differences 
in variability we're statistically significant on 1^0 6,f the / 
21 scales, with the disabJed groJf) reflecting more variability. 
On t (5 of the*c.e1naining \\ scales, -variabi frty ^was consistently 
higher, for the disabled group but w^s not statistical l-y sig- 
nificant. 

» 9 

The .developers report construct validity that is drawn^rom 
the. Theory of tyork Adjustment (Daw^s, Lofquist, & Weiss, 1968), • 
differences among occupationa I groups and factor analysis.v 

For, the short form, the devtelopers.j^epo'rt validity that is 
i nf erred, from, the long form a£ well as validity established 
by the study <?f differences in occupational groups ^and, studies 
of therelatfonship between satisfaction and sati sf actor iness 
as specified by the Theory of Work Adjustment. 

The MSQ proyides theoption of a long or short form, is quickly, 
administered, Is understandable, and has had a lot of research 
done *on it. / V 

The current manual is notvcomp I ete enough and the norms are not 
up-to-date, ,A, revised manual ; is being pr^ared. hlso, the 
measure was deyeloped in the confext of the Theory of Work 
Adjustment^ (Dawis, Lofquist, & Weis%, 1968) and Is most useful 

when used in that context. ' K , * * 

* " » * * * > 

Dawi^, R. V., Lofquist, L. H. , & 'Weiss/ D. J. ^'theory of 
work adjustment (a revision 1 ). Minnesota Studies' In Vocational 
Rehabilitation: XXI I.I, 1968. % ^ / ~ ^ 

Weiss, D. J., Davrrs, R. V., England, G. W.*,, & Lof qiUsl^t. Ji. 
Manual for the Minnesota satisfaction quest-foffna i rep M \ nnesota^ 
S-tudies in Vocational Rehabilitation: XXII, 1967. 



.Both the long fonr^and short fom#bf the VISQ, as well as corftputer, 
^scoring services, q^n be punchased fronv — * , 
' * * * * 

Vocational Psychology ReseaT^ 
N620 Elliott Hall ■ 
University of Minnesota. '* . * 
v '".-. 75 ; East River Road* f . \ lm . 

■ : ^Minneapolis, MN 55455 1 -* , 

'A new niSnual for the MS£ is currently *beh^ prepared, 
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Y SAMPLE » ITEMS -' / 

> / . * \ 

MINNESOTA SATISFACTION QUESTIONNAIRE 

The* purpose of this questionnaire fs to* give you a chance to tell how you 
f^eel about, your 0 present job, what things you are satisfied with and what 
• things you are not satisfied with, * s 

On the basis<of your answers and those of people iike'you, we hope to get 
a better understanding of the things people like and'dislike about their 
jobs, y 

On the following pages you will 4 find, statements jttr^ut your presenf job. 
Read, each statement careful ly. . ^ 

Deerde how satisfied you feel about the aspect of your Job described by the 
statement. * J 

Keeping the statemerrt in mind: < - / 

/ If you feel that your job gives you more than you expected, 
' ■ check the^ox under 4 "Very Sat." (Very Satisfied); * 

-- • if you feel that your job gives you what you expected, check 
the box under "Sat." ( Satisfied);* 

— if *you cannot make up your mind whether or not the job. gives 
you what you expected, c^heck the box under "N" (Neither Sat- 
isfied nor Dissatisfied);* 

> y 

— if you feel that your job gives you less than you expected,* 
check tt^e box under ""Dissat. " (Dis$atisf,ied) ; ' • 

— if you feel that your job gives you much, less than you expected, 
check the box under "Very Dissat." (Very Dissatisfied)., 

Remember: Keep the statement fn mind when deciding how satisfied ypu 
feel about that aspect of your job.' 



Do this for a^J^statements. Please^answer every Iteip. 

JBe frank and honest. Give a true ^icture^Jf your feelings about your 
J- present job*. ^ s m > 



-'.ON MY PRESET JOB, THIS IS HOW* I FEEt * 
ABOUT ... ' 

*4. The chance to be of service to others 

2. The chance to -try out some ofjny own 
fdeas . . . . a . . . . . ' ..... \ 

t . 

3. "cBelng able to do the' job without 

feeling it is. morally wrong 



Very 
Dissat. 


Dissat. 

-> • 


fcj Sat. 


Very 
Sat. 


□ 


□ . 


□. P . 


•'□ 


□ ■ 


□ 


Q □ 


□ 


□ 




□ □ 


□ 
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i|r ' v Very 

• . v Dissat. 

4. The chance to work by myself . . CZ1 

5. ^The variety in my work EZ1 ' 

h. The change to h^ve otl\er workers look to i — i 

me for direction I I 

7. The -chance to do the kind of work that I i — i 
do b*t A . LJ 

8. ' The social position in" the comrhuni.ty that i — i 

goes with the job . . . . . I I 

9. The policies and practices toward , i — i 
employees of this company I I 

10.. The way my supervisor and ^understand i \ — i 

each other ....... . 1_J 



Very 

Dissat. N Sat. Sat* 

□ • Cb □ □ 

□ '□ □ □ 

□ • □ Q □. 

□ □.□ □ 

□ □ .□ □ 



* i 



Reproduced J>y permission* Copyright (5)1977 by. Vocational Psychology Research^, ^ 
Un f vers tty^of- -Minnesota, / # 1 s 
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PATIENT SATISFACTION 
WITH ADJUSTMENT TO BLINDNESS TRAINING SCALE 



Developer (s) 



Purpose 



Desori ptipn 



' Xh i s sca.le was developed 'by Walter Needham andtWllliam R\ 
' De L'Aune; bljth at 'the Vete.rans /(dministna^ion Hospital in, 
.Vtest Haven, Coryieqt icut, i?r~l975. i 

i^The scale is designed to measure clienrt satisfaction with 
^residential ^adjustment to blindness training. 

" Y * • 



.The scaje consists of 27 items which measure client satisfac-* 
tion,with services provided via' residentia-l adjustment to 
bljndness training. Client satisfaction is assessed In, the 
following areas* length of training, orientation and mobility, 
manual skills, communication train-ing- (e.g., taping and use of 
recording devices), braille training, recreation, living • - . 
/ skills (e'.g., groomfng, cooking, room maintenance),, social 
( >"work services, psycho log ica I services (e.g., testing, counseling, 
\ and psychotherapy), bMndfold 4 training in mobility (for persons 
xnot totally^bl ind)J general satisfaction with blind skill 
training, and satisfaction with one's life. 

T^e -items on the scale are either checkl! sts or open-ended. 
The checklist questions usually i^/olve five alternative 
answers which range from expressions of extreme dissatis- 
- faction based upon^&Ja'ck of seryices\and training to s&tis- x 
faction with adequate training and servj-ces to extreme dissatis- 
faction based upon an overabundance 'of twining. 



Us? 



• The scale Is designed to be used yjuth.birnd or low vision , 
clients. Ht sfeems useful in settings where skill development 

* fs to occur (e.g., rehabilitation facilities). It is'benefi- 
cial to program managers as well' as case managers. Indications 

'■ ■ of client s6tisfdct_ion/dissatisfaction alert program managers. 

to needed modifications in the program and may also underscore 
} . ^ existing benef i cia I- aspects of the program. This scal : e seems to 

have the potential for providing a longitudinal assessment by 
which to'measiire effects of changes in the program and serving 
. * as' 3 comparison with other agencies. f ' 

Administration / Thi*s self-report scale is mailed to the cli'ent at least s/tx 
months after the completion* of training. It may be srelf- 
* administered* or administered by a reader if the client, does 

^ - not have suf f icient- sight* -The-time required to complete the , 

'scale Is about 20-30 minutes* 



Scoring 



The item responses are weighted from I to 5, with I representing 
extreme dissatisfaction due to a lack of .services provided - 
* and 5 C representing extreme dissatisfaction because of too much 
training.* For each item > * frequency counts* and percentages are 
defermi*€d for each answer choice^ as welf as the mean score and 
standard deviation. The ntean* scores of , re levant items can then 
be/tised'to establish satisfaction indices In each of the blind 
ski II areas, for overall patient satisfaction, and for life 
' satisfaction.- The scale can be hanifsc^red; 



Rel iabi I ity 
Validity 



Advantages 
Limitations 



References ♦ 
AvaMabi I ity 



'■1 
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The reliability of this scale has not been determined. 



This Scale has not been formally validated. However, sub-\ % 
•sequent feedback from /patients on an informal basis (i.e., • 
phone^calls, return visits) seems to indicate that the obtained 
results do reflect pa| femes'- views accurately. 4 *"/ 



~ifies the nature of the dissatisfaction. 



The rating system spe 



The construction of the scale tends to limit the positive 
expression of satisfaction since one cannot express extremes 
within tfte present format of the questtons. For iTVS^ance,' only 
one alternative denotes sati sfaction wh i le four denoteNvary I ng 
degrees of dissatisfaction. ■ * ' 

Needham, W» E. & De L'Aune, W. R. Patient satisfaction wi^h 
residential adjustment to blYadness training. New Outlooks for 
the Blind, May,* 1976, 70 "(5),' 102-187; 

Single copies of -the scale can be obtained from 

Walter Needham • . 

Psychology Serv^es • v '* 

VA radical tenter 
* ' . 'West Haven, CT 06516 ' j " 
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SAMPLE- ITEMS 



VATIENT SATISFACTION WITH ADJUSTMENT 

S TO BLINDNESS TRAINING SCALE 

f . * 



J Please check qne of The following answers toeach question, 



Cons I der th€ 
ments below 



iunt of mobili-ty training 
describes your feelings 



you recei.ved, 
about it? 



Wh'Ich of the state- 



i 



( 



ft 



I . 

2. 
3. 

5. 



wanted or now find that I needed much more mobilfty training, 
wanted or now need. a little more mobility training than I received, 
received just the right amount of mobility trainjng.- 
received slightly mbre mobility training than I wanted or could use. 
received much more mobility training than I waoted or could use. 



kfi evaluating 
e Center, wh'rch 



the ^Manual* S*ki f Is or 
of the fol lowi ng 



shop training you were provided with at 
statements are most true? 



I . 

2. 

3. 
4. 

5, 



or 
or 



find 
f Ipd 



that 
that 



I 



I 



needed a great deal more Manual Skills, 
needed a little more Manual Skills 



I would Ijave I iked 
V would have I iked 

than I received. it 
I received just about the right amount of Manual Skills training. 
I received a littiip more Manualigki I Is training $han I wanted or'needed 
I received much more Manual Ski Us training than I" wanted or needed. 

/ 



WKich of the following expresses yobr feeling about your .Commun i cat.ions 
elk sses (typing, uses of recording devices, etc.)? 



/ I 



needed or wanted much more training of this. type. . 

needed or wanted a little more training of this type. 

received aboui^^h^at I needed or wanted of this type of training. 

recei ved £ I ightly more training of this type than I needed or wanted. 

received much more of this tra i ni ng, than I needed or wanted. 



11. Consider the recreationa f^acti v j ties you had while at the Centfer, such" as 
* bowling, (Jajici ng/ gol f , flihing, etc. W^re these — , 

" I. Far too few? J 

Z. A few less* them would be desiraBle? 

3. £bOut the right 'number? f 

4. A^ f ew more than was good? 

5. Far too many?, - 

12. To what exten;p would you like to, have participated in an , Intensive physical. 
. , education and/or physical conditioning program at the Center? 

Very much for it * 
SomeWhat for It 

3. Feel Indifferent about it one way or another 

4. Would be somewhat against it 

5. # Would be very much against it * 




,-erIc 



:1 



^97 



13. In* genera I, <how satisfying is your life at the present" time? 

I. Extremely satisfying * S 4 

2'. Somewhat satisfying % ^ 

2?. Neither satTlf y I ng *or unsatisfying 

_2 4 * Slightly unsatisfying ^ ' 

5. Very unsatisfying 



14. "Mini courses" or* refresh e^r courses are avajlable at the Center- Do you: 



I . , Like this bd^a? - yes j_ 

j ^2. How long "Should they^be? ___ 



no 



3-* How long after taking the* "f! rst program shou[d a person have'to wait 

*to be eligible for them? i 

4. What should they emphasize? ; 



15. Bl indfbld 'tral ning in Manual Skills wa$ — 

¥ • * f 

L Vlery^ he I pfu [ 



2. SomeCajat helpful A 

3T Neither he I pf t>l or detrimental , '^P 

4. 'Sojnewhat detrimental , / 1 

5. Very detrimental 



. Question dofes not apply — did riot have blindfold training in Manual 

X Ski I Is. - J - * - • s 



* . .... ., . s 



/ 



7 



& • 



J 



if 



\ Reproduced 'by permission of Walter Needham,, f 
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SCALE OF CLIENT SATISFACTION 



. Developer(s) 



Purpose 



The Scale of Client Satisfaction was developed by Kenneth W. 
Reagles, George N. Wright, and Alfred J. 4 ButIer St the Regional 
Rehab i 1 1 tat fcn, Research I nst i tute, 'Uni vers I ty \sf WiscQn'sin - 
Madison In '1969, 

^Wh^s scale is designed to assess former rehabilitation Clients* 
satisfaction with rehabilitation services. It is a fo Mow-up 
sea la. . * 



Description The scale consists 'of 14 items. The items are multi-point 



Use 



ratings or yes/no responses*. ^The scale assesses former rehabili- 
tation clients 1 satisfaction ^th"services received from the ' 
rehabilitation agency. The areas investigated' include satis- 
faction with time spent with the counselor. 

The scale can be used with alj clients and is useful to case 
managers and program managers. Information on^ciients-' 
satisfaction or dissatisfaction with program services is 
valuable in identifying strengths and weakness.es of programs 
and can fead to more planning, and improved service delivery. 



f 



Administration 



Scoring 



ERiC ' 




Validity 



■ 1 *- 
"An expanded and refined version would represent an 'important . 

step in the continuing effort to assess the impact of rehabili- 
tation upon the, individual served* Perhaps its greatest use - 
since a single score of satisfaction is Obtained - wpuld be 
to determine the correlates of satisfaction , and to determine > 
which int^rventive counselor functions are most relaffed to 
clients 1 expressed satisfaction*. J . ' * . • 

The scale is sehf-report, and it i s A recommended that the ^sca le 
be administered* six months after closurd. It can be adrafn-lstered 
via mail survey or personal in^erviev?. ' 

An item weighting scheme was developed using RAVE' ana I ys i s,"" 
which would maximize the scalers internal consistency. A * < 
total score of client satisfaction for each cl lent 'Is. ca leu fated 
b^y summing the appropriate^ weights for the 14 item responses * 
given. — ^ 

This scalers administered to 483 Vehabi I i tated clients six 
months after successful 'closure. A Hoy,t reliability coefficient 
of .'83 was obtained, indicating evidence of the scale f s 
unidimension^l tty. inter-Ttem correlation coefficients ranged > m 
rom .09 to .67, with most between .22 and .31. 

Thadeve lopers report content validity based on the agreement 
of Individuals knowledgeable in the dimensions of client V . 
Satis\actiof|. . * 
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*/ Advantages The developers* report that this measure yields a. total score 

* th^f 1 could be considered as interval data. 

* ' - V . , * 

Imi-tatjons v iWhHe the items sample client satisfaction with a relatively 

* wide rar>ge of rehatf f Ittation activities, they tend to 'emphasize 

fhe' cl ient*s response to direct interaction with the -counselor. 

' ' * Therefore; the items may not fully represent the concept of 

client satisfaction. • 1 

♦ - •/ * 

■ . * f 

References Reagles, K.W., Wright, G. N., & Butler, A. J. Correlate of 

client sat rsf act ion *fn an expanded vocational rehabilitation 
program. Wisconsin Studies in Vocational Rehabilitation , 
Monoqrabh XI I, Series 2, 1970. ♦ 

, v Reagles/,- K. W., Wright, G. N. , & Thomas, K. R. Client satis- 

faction as a /function of i ntervent i ve' counselor •behaviors. 
Rehabilitation Research and Practice Review, Special Spring 
-Issue. 1972, 3 (2,), 23-29. w 

* .y * / * 

Reagles, K. W., Wright, G. N., & Thpmas, K. R. Development 
of a scale'of client satisfaction for, clients receiving voca-- 
tional rehabilitation counselor services. Rehab i 1 1 tat ion 
Research and Practice. Rev-iev^ , Special Spring Issue., I9?2; 

S 1 < 2) > l5 ~ 22 - 

Availability i The scale' is included in the £eag les> et eJ . (1970) reference 

cited .above. It can be obtained from 

■f 

"National Technical Information Service 

U.S. Department of Qamne.rce . 
''5285 Port Royal Road / > \ k 

* * ' Springfield, VA 22151 . * 

It ^s a part of the following document: ' 

/< . - - 

University of tylsconsin Regional * * 

Rehab i I i tat ion * Research Institute. ( . 
Wisconsin Studies in Vocational 
Rehab t 1 1 tat Ion. Series 2. Monographs 
XI Thru XVI. „ < • 
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SAMPLE ITEMS 
• ' 200 




SCALE OF CLIENT SATISFACTION " 

2. In dealing with your disability, who dp you feel has y helped you the most?, 
• (Che:k only the one who is most' important.) 

I * 9 ' \ 

I Doctor or medical specialist / - 

. 2 Psychiatrist gr psychologist 

3 Rehab i I i tat U§\ counselor * , 

4 Counselor in an agency other than Vocational ^ 
Rehab i I i tat ion s 

5 Teacher or teachers i * 
,6 Clergy member (minister, priest, or rabbD - * 
7 Other (explain) ' 

8. Do you feel that the counselor understood your problems and feelings? 



> >■ 



Yes 



0 No 



♦ • 



V 



.V , 



V 



Reproduced by permission. Copyright by. the -University of Wisconsin Regional- 
Rehab II I tat l on Research Institute. • 
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MISCELLANEOUS MEASURES 



V 



V 



) 



J 
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KIRESUK/SHERMAN GOAL *ATTAI NMENT SCALING jCGASX 



cfl 



/ 



Developer(s) GAS was developed Ijy Thomas J. Kiresuk and R: E. Sherman 
, the late l960 f s'as part of the National Institute of Merit; 

Health Program Evaluation Project loca+ed in Minneapolis, 

Mi nnesota . - 

Purpose % * GAS js a procedure for identifying defined goals and outcomes' 

f for £ljents and tttus demonstrating change within the client 

while in the rehabilitation process or af.teV treatment. 
• ■ • 

Description * Ea£h goal that -rs set constitutes a scale, or follow-up 

guide. The number of scales within the procedure will vary 
in that fhe number of goals of the different clients will 
1 vary. However, each scale has five level s 'as fol lows^ (I).' 

J most unfavorable outcome thought likely, (2") less tharf ex- 
pected success with treatment, (3) expected level of treat- * 
ment success, (4) more than expected success with treatment, 
and (5) most favorable treatment outcome thqught likely. The 
/ r%, > areas "i rivesti gated are essentially left to the discretion of 

the examiner and/or the client. Objectives can tjB 'designed { , 
to address any concern. The goals do not have»to*be behavioral 
* but- often are. Any content that N can be reliably followed up 

is acceptable /e.g., documents,' what someone says, test scores, 
grades, sp I f -reports, blood pressure,^ owns a car> is drunk 
during interview,, etc.). If* the procedure is being used solely* 
as'a treatment facilitator, where ret iabi I ity is not such a 
great concern, less, restrictive goals would be acceptable. 

Use The_ procedure is appropriate for use with all clients. It 

'can be used in , various settings (e.g., rehabilitation facilities, 
sheltered workshops, state-federal VRS, etc.) and. has been 
' * used in both rehabilitation and ruxi-rehabM itation settings. 
♦,'lt is usually used with individuals, but it could beused for 
\ defining goal? and dtitcbmes for couples or, families as well/ 

This procedure is beneficial to both case managers ^and program 
managers. For £ase mangers, .the definition.^ *goa Is and bb- 
£ jectives results In' a sounder Individualized Writterf Ttehabi I y 7 
itation Plan, and change x scores help delineate intermediates 
' goals that are necessary ^or the ^end goal of successful rehc(£>- . 

-vjHt^tion. It has also been shown to have a treatment facilit- 
ating effect in counsel ing treatments. Program managers wi I I. 
find the GAS, procedure Benef icial in admin 1st ra*ti.ve goal setting 
and In specifying prqgram and cqunseior effectiveness. J 

* Cl ient self -const nucted goal .formats have! a I so been adapted from 

thi s procedure. . fc 



«4 




FRir 



A^mi^strapirm GAS uses -a combination of professional observation, self-report, 
* and of ten *the report of oth0££ ('i.e., family). .At intake the 
clinician, worfci rtg* with the.clientj sets tnjpee to five *, 4 ^ 

. } ' 203 '' ' . 
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Scoring 




Rel iabi 



individual ized^oa I or the client and .estabT rshes'a scale 
of o^pdmes based c>q*the five levels described in'the Des- 
cription section/^bove. Those administering this procedure 
will require- stopfe, orientation to w learn to write behaviorally 
relevant goals/and expected outcomes. 



/ 



Fol low-up 'assessments can be conducted at various points 
m (e.g., predetermined .irtterva I s'duri n^ % treatment, Vermlnat ion, 
or post-treatmeht). - It Ms recommended that somfeone with^a" . 
B.A. administer the follow-up assessment, but'in practice the 
level of training of the* administrator varies .dependi ng on f . 
4 J"he* content of the goals and the" difficulty in col lectlng- the/ 
Outcome data. Outcome data can^e obtained through th^ re- ^ 
cords,^ by telephone, by, mail, or in : an interview.' The- intake 
process takes about^20 minutes to complete, and the follow-yp'.. 
ass'^sment takes afe^ut* 15 minutes*. . ' 

lis process is usually aft individualized one* However, degrees 
oVstandardization/have been used in programs wj # th clear, prior, 
expectations or highly sinvMar clients. 

The, seals scores at follov**up are weighted, summed, ancj con- 
ve^d to 'a. stancfard score £ 50, SD = 10).' Hand sOorfng 
is possible with, individual assessment, but computer scoring 
is required for* larger program assessment. Tables arVavail- 
able f for caj-culating "scores, as we If as a pocket-computer pro- ' 
gram v 'G/\S'users make use of both item achievement «data and 
the Wife I GAS score. Researchers usually u£e the GAS score 
alone. " 



r 




Te£t-rfetest rel Lability was examirled by* comparing the., fo'LJow- , , 
up guides that were ^constructed by two dif fergnt^cl inicians 
(intake w6rkers and therapists) at two -di f f er^nt points in 
time (about two- weeks, apart The reliabiji;iy coefficient 
yielded was* ,83a- - V * ' ' > 

I nterrater, agreement* examined 'in. two studies ranged from 
.95 to .99 in one study and froip '.66 to .81 in the'ofher; 4 N 
which ha.d an average of 25 days between scoring interviews. \> # 
Extensive traloHig d£ J ntervjewers and unambiguous follow-*' - 
up guides are important in^achievfng an acceptable level of 
interrater rel Kab I I ityT ' , 

In another' study clients and staff scored 50 cl ierit-cpnstructed 
follow-up guides, v The correlation between "^the scores -was' 
When clients and staff scored- ID st&tf-constrgcted guides, there 
was a 6orrelation of .86. 'The correlation between clients 1 
scoring of 1,0 client- and sta^f-eonsteutsted guides was .93, ' r .i 
v/hi le* the- correlation between staff scorings of the' JO client- ' . 
and, staff ^constructed guides was .90. The f-ntraclass correlation 
for 'fol low-up* rater pairs was *.87,. 4 • * 

The internal' consisi^ncy of the'' procedure was not expected to 
"e^hlgh; the goa I s. we're 'not A expected to'be highly correlated. 
The^tTi+encoo^ within clients was .27 for* 

a sample, of 693 people* ; , fc , . 
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The devefopers report a good match of follow-up guide content 
with client problem llsts'1'n-a crisis dteoter-and good overlap 
in^content between staff- and cl ient-cdnstructed goals in a' 1 
day treatment; program as evidence of the' procedure 1 s content 
vallgity.^ ' ^ ' . ' 

Goodyear and Bitter' ( 1974) found that this procedure could be 
used to assess client change in # the rehabi J i tation letting. 
BasejTon 41 patient*, i.n a fam-Ply and patient service unit of 
a Rehabilitation hospital, a significant 'difference was found 
between meaff ratrhgs at the time of GAS construction by the 
client's .counselor and fo I low-up 6 to 12 weeks later by fcther * 
staff members (t = 10.05, g_^.0l). . Mean follow-up .rati-rigs re- 
fleS+ing rehabilitation improvement were higher (50.88) than 
-ratings at the time of admission (3^.87). m It should be 'noted 
that in practice' the developers do nof recommend the use* of 
the pre-post change score; the f of low-up score itself is a 
fch^jige store. - , 

fc The ability of the -rehabH i tation counselor to predict cHent 
outcome was also examined. No s4gn iji'cant differences were 
found between the counselor's perception of expected outcomes ' 
at the time of GAS qonstrqction and actual outcomes. The mean 
expected - score for each of the^five counselors involved was* 
50.^00. The range of actual outcome scores *for th<e counselors 
was -48. 39' to 53>90. ' t 

Several advantages are derived from the use of this procedure. 
First,, the client can play 3 significant role in developing 
goals and objectives,* and in Such ca6es GAS can become a treat- 
ment facili-ator. -Second, it has great flexibility (i.e., v goals 
and weights are individually selected, client can be c«fripared s 
with himself /herself). Third, when added *f*o more standard 
measures, GAS giv&s the clinician a needed dimension fbc client 
relevance. Fourth,, the accomplishments of the staff may be * 
tJ better ngf Tected a^ outcomes other than gainful employment are 
^ckngwkedged. Finally, the procedure cap be applied 1 in many 
Situations (i.e., clinical process, qua I ity assurance, peer f 
rev\ few ) . • ^ ' 



First, the staff may resist learning to think in a goal-oriented 
fashfpn. 4 Second, the procedure does not work well when -adnpi n- m 
istered tefore enough is known about the cljent (e.*g., emer- 
gency sJruatlons), * Third, the psychometric properties may vary 
depend iftg on the use of the process. Also, the summary*score 
is not very us^fulJn a cross-prog ram comparisons; the fact that^ 
It (^o^^JMiave^ 

Goodyear, D. L. & Bf^fter, ^. A. Goa I .attai nment sea I i ng as a 
program evaluation measure in rehabi J I tation. Jourt\$\ i of 
Appl ied [Rehabi I ftatton^ Counsel i nq , Spring, 1974, 5 (t), I9-26T. 

. • * . C 



Kiresuk,^T. J.. ^Sherman) R. Goal atta i nment sea M ng ^ 
A general method f^r evaluating comprehensive mental health 
programs. ♦ Conynujlty Mental Heajth Journar TH968, £ (6), 
443-453. » ~' 

A bibliography on (£>al Attainment* Sea ling can be obtained from 
/t4ie Program^Eyalu^tion Resource Ceoter tse#, Avai labi I ity section 
be I ow~ for addness ) . v 



Availability Materials related to Goal Atta i nment vSca I ing can be obtained- 
~f rom - — 1 . , " • ' ■ 

9 • - 



Program Evaluation .Resource Center 
501 Park Avenue ^>uth 
Minneapolis, MN * 5541 5 
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GOAL ATTAINMENT SCALE 
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REHABILITATION GAIN SCALE 



Developer(s) 



Purpose 



.Description 



Use 



Admi nf strati on 

* 

Scoring 



Rel iabi lity 



This scale was developed at the University of Wisconsin 
.Regipnal RehabM f tation Research Institute in the' late I960 f s. 
Kenneth W % Reag'les,. George N. Wright, and Alfred J. Sutler 
were involved in its development. ' 

• * < 

The* Rehabi I itation Gain Scal^e is^desighed to assess client 
change due to rehabilitation services. ( 4 

The scple consists of twenty items*- both multiple choice and 
fill-in -vaSdressing me.nta I and^physical health, vocational 
outlook,' economic status, and participation in various social * 
and< feisure acti vi-ti es / • 

' s * . • : t 

The measure has been used with the physi'cally and emot i*ona I ly 
disabled, mentally retarded, and culturally disadvantaged. 
(See Reliability section for further details on how this scale 
was us^ti wifh these c I ient ^groups during sea I a development). 

4 ! 

The ability to assess the clients status on this scale at any 
"ppint in time broadens the'uses to which th^s measure can bQ put, 
Counselors c£n usfe it "to evaluate client progress and thei?* 
own effectiveness. Program evaluators can use it for program 
planning, legislative documentation, and counselor evaluation., 
Program evaluators and researchers who are interested in tooking 
a't/outcomes Can use this scale as a dependent variable measure; 
demographic and process variables can be examined for their 
influen.ee on client outcomes. 



d!2 



This scale was a precursor to the development of the Human 
Service Scalfe , a Iso developed at the Universit^of Wisconsin 
Regional Rehabilitation Research In^itute. 

The scal-e may be self-administered or administered in an „ 
inteVview. Pre- and post-measures need to be taken. - - 

An item weighting scheme was developed using RAVE. analysis, 
Which would maximize'^© sea le' s J nterna I 'consistency. . A 
total score for, each client is calculated by summing the 
appropriate weights for the {tern responses given. 

The t rel iabi J J ty da'ta reported he low were based on client 1 
performance on this scale's 20^1 terns a£ they appeared within 
pre- and post- rehaB M i tation measures administered as part 
of a client test battery for a pilot expanded vocational . 
rehabilitation program. The 20 Items were not administered 
dt t a unit* -Item selection and statistical computat rfons ♦neces- 
sary to establish this scale were done after the entire client 
•test battery had been adml nfstered. » 
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Hoyt reliability coefficients yj elded b^RAVE analysis .were 
^examined to determine If the 20 Items actuajly measured a 
' * single underlyi ng • van ab le - that of rehabilitation gain. 

Data .from ""310 I rents who* had completed all of the necessary 
parts of the prd-post measures In the pilot program were used* ♦ 
-Clients included the rrfenta I ly and physical 1/ disabled, mentally^ 
^* "retarded, and culturally disadvantaged. Three sets of data 

s were examined; pre-rehabi I itatioh level data, post-rehab! 1 1- 
*. tat ion level dafa\ and, rehab I 1 1 tat ion gain ciata. Coefficients' 
C were "moderately nlghiL but acceptable for a s^le composed 
v .» ^ of manV seemingly unrelated items (.76 for/ne pre-rehabl 1 1- 

tafh^n l^vej scale,' r78 for the post-reh^i ] ftation level scale, 
and*. 71 for the gain scale). These datau%ln additlof) to the 
acceptable I Lmi^fs of "the pattern* of derwed weights, item-to- 
• , ■ total score correlations, and inter-4.tem\porrelations, indicate 

fhat this^scale does reflect a-siggl t e^variabie. 

Validity. The developers report ^content va I i cWty' base^j on the scaled 

4 .covecage of areasTTaditibna I ly^ncluded as measures of rehablli 
tat ion outcome. * 

> » - 
Advantages * The client cart be assessed at any point in^ime, arid the scale^ 
has important potential as a research instrument for the 
s measurement of t t he differential effects of VR i nteryent ion. 

Limitations --^^fhe doma-i^n of rehab i M tat ioji gain-is not fully reflected. 

References Reagles, K. W., Wright, G. N., & Butler, A. J. Rehabilitation 

~ gainr Relationship with client characteristic^ and counselor 
intervention. Journal of .Counse 1 1 nq Psychology. 1971, J_8 (5), 
^499-495. 6 ^ * ; n . ' . \. - ' / ^ . < 

Reagles, K. W., -Wright, G. N.*, 4-Butler, A. J. h A scale <*f 
rehabilitation gain for clients of an expanded vocational 
rehabilitation program. Wisconsin Studies in Vocational 
* Rehab! ligation, Monograph XllT^Se,ries 2, 1970.. 

Availability The sca-Ie J s k I nc I uded in the Reagles et a I ♦ (1970) reference * . 
cited, above* It- can be obtained from 

NatipnaJ Technical -Information Service 
D.S. Department of Commerce 1 
1 . • , 52B5 Port Royal Road \' 

, Springfield, VA 22161 

• # * ' 1 

Jf is a part of the Ao\ low{ng document: * , 

' w '1 v 'tin J verbify of y\ scoas*In Regional 

Rehfbl litaTlrrn Research- Institute. , - , *» 

V/Isconsln Studies in Vocational 
< Rehabl Htation . - Series 2« Monographs 
• XI Thru^XVU • ""7 

Order No. PB 261 175/AS 
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f SAMPIE IT^MS- 

1 ♦ i 



REHAB I L1TATJ0N GAIN SCALE 



i ' ■ • * . 

, Item 4: "If the work you prefer were available, what would be your 
jft chances of getting such a job? 11 

* 

I) almost certain; 2) very good;" 3) 50-50; 4) not so good; 5) very little chance 

Item 10: "If you wor^ which of "the following activities do you take v 
part in where you work? " + • 

1 . . > • 

a) Belong to some type of club or organization compose^-eJ peop le 
.where I work or in my profession ] 

b) Belong to a union; attend union meetings ' * ♦ S 

c) Socialize after wtfrk hours with f el low workers J* 

d) Other activiti-e^ related fcT your J^ork (describe) / t 



Item I h "WhatMs the* total numbejf of hours ^^spend^^eacfxv^ the 
activities you-circled infrhe list above?" ^ 

' s . * 

ho^jrs per, week. . . f 

Ltem 13: /'Which of the following activities do you .take part in with 
^other people in your Community ?" 

} J ' * , *. 

a Sports footba 1*1, basdball, basketba M , tennis, golf, etc. 
. Outdoor activities: hdntjng, ;fishing,. hiking, etc. 

c) Inxtobr acTTvities: bovJling> table tennis,, danci/ng, cards, r etc. 
/ , d) Organized socjal activities: social clubs,' serjgice"l?tybs/ 
„ card clubs, church-sponsored social activities' A x 

e) Othgr social acttvities ("describe) 



h 
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VIRGINIA REHABILITATION GAIN SCALE 



1 t - 



f 



DevelcJper(s), * "The scale W8S developed by Alex Hawryluk of Old Dominion Univer- 
\ sity for the VIVg I nia Department of Vocational Rehabilitation 
from 1972- I&73. it was patterned after the Rehabl I itation Gain 
*' m • Scale , developed at the University of Wisconsin Regional Rehab- * 

ilitatioh Research Institute.' 
, '% 

Purpose •'The'scale purports to measure client orange and sustentipn of 

- ' ^ , gain. ^ 

Descrfption * The 14-item scale includes vocational itenrfc and se I f -percept ion 
measures. Areas investigated include'the work Status, economic 
'dependency, and psychological well-being of clients who have 
# received VR services, AH ftems are rpu Iti-point , 

• • 

. Use * The scale was designed for use with disadvantaged/df^abled 

clients'. It has been used in vocational rehab i I itation 'outreach 
N programs in cooperation with the Model Cities program*, It 'is 

appropriate for all categories of vocational rehabilitation 
* ell ants, , * 

' ' The scale, is useful. to both case managers agd program Jm^nagers, 

Pre-measures. may a l^rt case managers to needed servj^pes. This 
measure is, useful to program managers in eva-lua+ing the irp^act ' 
>f both experimental and routine programs. ^ Comparisons of p'r£- 
ind post-meastires IndTcate changes 'derived from program partic- 
ipation, thereby pffering program managers an indication of tbe 
^ef fetet i veness of the program. The effectiveness of different . 
programs can also be compared* / 

Administration* The scale can bo administered by a counselor, j^cial worker, 
case aide*) or experienced,- mature clerical staff .person i*n 30 
* mhftjtes (10 minutas if the psychological well-being s.ection is 
§ m excluded)! The psychological' wel l-being section requires self- * 
. • report by the client, ' It is recommende^t^that The measure be 

administered at re^^^fal and*agalrf at foll6w-up (after one 
' 4 year) . ■ \ 

Scoring. This sfcaje compares clients' changed economic and- employment 

% ^ st$ws with a I'arger vocational rehabi I ita/Hon constituency. > 
The dimensions that are scaled are hours per 1 week gainfully. 
( occupied, weekly earnings, work^tatuSj economic dependency, ^ 
and psychological well-being (opf!?S?aI)\ Improvement or / 
^deterioration along each of these dimensions is calculated^ 
' * for each client. It Is then* compared to the larger cl ient 
^ population. The client's change as compared^ with the average 

change .for all clients is converted to a scalg vajue/ The 
scale val'aes for each dimension *are totale.d to yield a gj/oss 
rehabilitation gain (or* loss) value. This approach permits 
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theHjyntJjes? s of vaJues-Zfrom essentially dissimilar criteria ' 
. (e.g., -work status, and weekly earnings). 

ScoVes^ can be i nterpreted' a long individual dimensions to show 

^ relafiva improvement in earnings/occupational status, etc., 

or as an aggregated measure* of economi c, 'occupat iona I , and 

psychological well-being? ' , 

♦ 

The measure is hand scored and can easily be adapted to machine 
scoring. . * * 

■ \ 
The developer reports that the scale ^es pretested on a sampl^ 
of 25 clients and subsequently administered successfully to a 
population of 433 vocationaf rehabilitation clients. 'However, 
no^ evidence of reliability was presented in the materials 
reviewed. : < * 

Of 433 clients refer red > TtNan experimental vocational rehab- 
ilitation program, fol tow-up data one year after referral re- 
lating gain to last status were obtained on 183 clients. The 
follow-up gcoup did not constitute a random sample of the 
referred clients; the group contained a disproportionate num- 
ber of blacks, females, persons wMJt^psychologica I rather than 
physiological disabilities, and referrals from bureaucrat i zed 
organizations. The findings indicated that one year after 
referral clients clospd rehabilitated (Status^ 26) showed higher 
nean gain 2.06) than cl ient^^t i I I in process (mean gai'n 
Ir clients rejected^r^etosed not rehabilitated (mean 
h) (chi— square = 10.33, 6 6f) . m ' 




Advantages of using this instrument- include the following: - 
(I) It is^asiiy scored; (25 the focus is on client character- 
istics sal lent 'to the basic 'mission of vocational rehabilitation 
(3D key dimensions are behavioral, thereby avbijd i ng' counse lor 
j and client bias (excluding the psychological well-being dimen- 
* '^-sfon, whfkch is served by a client-completed se I f -percept ior\^ 
instrument); (4) high content and face validity are* reported * 
the developer; and (5) pre-- and post-measures afe-obtai ned. 

me^ma^or difficulty of the scale rs with the acfmj nist/ation 
of the follow-up instrument. Client i naccessf pi I i ty ertcumbers 
f\\e data gathering process. 

B^ssett, P.-T. Measurement of outcomes r A report from the study 
group on measurement of outcomes^ Tirst Institute on Rehabil- 
itation' Issues, Denver, Colorado, 'April .1-5*17, 1974., Institute, 
We*st*Vic§Jni a: Research' and TriSinfcfig Center^ ! ST?4 \ m 

Hawryluk,\ A« Rehabi 1 ttatfon gain: A new criterion for an old 
concept. Rehabilitation Literature, November, 1974, 35 CM), 
322-328; ~ 
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Availability Assistance in the construction of such scales is available 
' upon the request of responsible agencies 'from - — 

./ Alex Hawry luk, Chairman 

— ^) Management .Department 

* , School of Business 

Old Domi nion „ University - 

Norfolk,* VA 23508 * 

♦ * • ** \ 
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